perception
/
dss
1
1
Fork 1
Code Issues Pull Requests Projects Releases Wiki Activity
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
76 Commits
1 Branch
0 Tags
517 KiB
 
 
 
 
Branch: master
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'master'
${ noResults }
Perception 11929904bd
Add 'json' class to json link 		5 months ago
bin Use env var P to download less 7 months ago
routes Add route /article/:slug 5 months ago
sql Drop old index too 7 months ago
templates Add 'json' class to json link 5 months ago
.eslintrc.js Merry Christmas 2020 7 months ago
.gitignore Ignore *.db instead of just main.db 7 months ago
.jshintrc Merry Christmas 2020 7 months ago
.repl.js Initialize global.db in repl 7 months ago
README.md Document environment variables 7 months ago
index.js Add route /article/:slug 5 months ago
package-lock.json Add escape-goat and upgrade axios 7 months ago
package.json Add escape-goat and upgrade axios 7 months ago
page.js Escape search query correctly and fix pagination 7 months ago
site.js Add robots.txt 5 months ago
top-tags.json Preload a static list of top tags on home page 7 months ago

README.md

Daily Stormer Search

A Search Engine for the Daily Stormer

Installation

In the root of the project, do the following.

# Install node modules
npm i

# Initialize database from scratch
sqlite3 main.db < sql/ds.sql
sqlite3 main.db < sql/ds.001.sql
sqlite3 main.db < sql/ds.002.sql

# Alternatively, download a database snapshot.
wget http://dss.coincidencedetector.com/archive/dss-latest.db.gz
gzcat dss-latest.db.gz > main.db

# Run the server
micro-dev -p 1984 site.js

Downloading Articles

# Download all articles from scratch:
# This takes a few days and may need babysitting in case of crashes.
bin/download-all

# Dowloading the last 140 articles per category:
# If you have a recent snapshot, running this once is how you should get it up to date.
P=1 bin/download-all

Cron

To periodically update the database with new articles, replace the value of DSS_ROOT with the path to where DSS is on your system, and place the following in your crontab.

DSS_ROOT=/path/to/dss
  55  *    *    *    *  cd $DSS_ROOT && bin/articles-update

Environment Variables

PATH

Make sure your PATH includes node_modules/.bin. Running micro-dev probably won't work otherwise.

DSS_DB

By default, this code assumes the database is at ./main.db in the root of the project directory. If you want to use another database, you may specify its full path in DSS_DB.