perception
/
dss
1
1
Fork 1
Code Issues Pull Requests Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
77 Commits
1 Branch
0 Tags
444 KiB
 
 
 
Branch: master
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'master'
${ noResults }
Perception cec820d41d
Add CORS headers 		2 months ago
bin Use env var P to download less 10 months ago
routes Add CORS headers 2 months ago
sql Drop old index too 10 months ago
templates Add 'json' class to json link 8 months ago
.eslintrc.js Merry Christmas 2020 10 months ago
.gitignore Ignore *.db instead of just main.db 10 months ago
.jshintrc Merry Christmas 2020 10 months ago
.repl.js Initialize global.db in repl 10 months ago
README.md Document environment variables 10 months ago
index.js Add route /article/:slug 8 months ago
package-lock.json Add escape-goat and upgrade axios 9 months ago
package.json Add escape-goat and upgrade axios 9 months ago
page.js Escape search query correctly and fix pagination 9 months ago
site.js Add robots.txt 8 months ago
top-tags.json Preload a static list of top tags on home page 10 months ago

README.md

Daily Stormer Search

A Search Engine for the Daily Stormer

Installation

In the root of the project, do the following.

# Install node modules
npm i

# Initialize database from scratch
sqlite3 main.db < sql/ds.sql
sqlite3 main.db < sql/ds.001.sql
sqlite3 main.db < sql/ds.002.sql

# Alternatively, download a database snapshot.
wget http://dss.coincidencedetector.com/archive/dss-latest.db.gz
gzcat dss-latest.db.gz > main.db

# Run the server
micro-dev -p 1984 site.js

Downloading Articles

# Download all articles from scratch:
# This takes a few days and may need babysitting in case of crashes.
bin/download-all

# Dowloading the last 140 articles per category:
# If you have a recent snapshot, running this once is how you should get it up to date.
P=1 bin/download-all

Cron

To periodically update the database with new articles, replace the value of DSS_ROOT with the path to where DSS is on your system, and place the following in your crontab.

DSS_ROOT=/path/to/dss
  55  *    *    *    *  cd $DSS_ROOT && bin/articles-update

Environment Variables

PATH

Make sure your PATH includes node_modules/.bin. Running micro-dev probably won't work otherwise.

DSS_DB

By default, this code assumes the database is at ./main.db in the root of the project directory. If you want to use another database, you may specify its full path in DSS_DB.