Operations Guide

Day-to-day server operations, monitoring, and maintenance.

Server Access

ssh [email protected]
cd /home/rondo

Checking Sync Status

View Cron Schedule

crontab -l

View Recent Logs

# List recent log files
ls -lt logs/cron/ | head -20

# View latest people sync log
cat logs/cron/$(ls -t logs/cron/ | grep sync-people | head -1)

# Tail a running sync
tail -f logs/cron/sync-people-*.log

Check if a Sync is Running

# Check for running Node processes
ps aux | grep "node sync-"

# Check lock files
ls -la .sync-*.lock

Manual Sync Runs

Individual Pipelines

scripts/sync.sh people           # Members, parents, photos → Laposta + Rondo Club
scripts/sync.sh nikki            # Nikki contributions → Rondo Club
scripts/sync.sh freescout        # Rondo Club members → FreeScout customers
scripts/sync.sh teams            # Teams + work history → Rondo Club
scripts/sync.sh functions        # Commissies + free fields (recent updates)
scripts/sync.sh functions --all  # Commissies + free fields (all members)
scripts/sync.sh discipline       # Discipline cases → Rondo Club
scripts/sync.sh all              # All pipelines sequentially

Single Member Sync

Sync a specific member by KNVB ID:

node pipelines/sync-individual.js KNVB123456 --verbose          # Full sync
node pipelines/sync-individual.js KNVB123456 --dry-run --verbose # Preview only
node pipelines/sync-individual.js KNVB123456 --fetch --verbose   # Fetch fresh data from Sportlink first
node pipelines/sync-individual.js --search "Jan Jansen"          # Search by name

Direct Script Execution

For debugging individual steps:

node steps/download-data-from-sportlink.js --verbose   # Download only
node steps/prepare-laposta-members.js --verbose         # Prepare Laposta data
node steps/submit-laposta-list.js --verbose             # Submit to Laposta
node steps/submit-rondo-club-sync.js --verbose             # Submit to Rondo Club (includes birthdate)
node steps/download-photos-from-api.js --verbose        # Download photos
node steps/upload-photos-to-rondo-club.js --verbose        # Upload photos

Database Inspection

Member Lookups

# Find member in Sportlink data
node tools/show-sportlink-member.js [email protected]

# Find member in Laposta tracking
node tools/show-laposta-member.js [email protected]
node tools/show-laposta-member.js [email protected] 2   # Specific list

# Show pending Laposta changes
node tools/show-laposta-changes.js        # Changes only
node tools/show-laposta-changes.js --all  # All members with diffs

Direct SQLite Queries

# Member count
sqlite3 data/rondo-sync.sqlite "SELECT COUNT(*) FROM rondo_club_members"

# Members needing sync (hash mismatch)
sqlite3 data/rondo-sync.sqlite "SELECT COUNT(*) FROM rondo_club_members WHERE last_synced_hash IS NULL OR last_synced_hash != source_hash"

# Photo state distribution
sqlite3 data/rondo-sync.sqlite "SELECT photo_state, COUNT(*) FROM rondo_club_members GROUP BY photo_state"

# Team count
sqlite3 data/rondo-sync.sqlite "SELECT COUNT(*) FROM rondo_club_teams WHERE rondo_club_id IS NOT NULL"

# Commissie count
sqlite3 data/rondo-sync.sqlite "SELECT COUNT(*) FROM rondo_club_commissies WHERE rondo_club_id IS NOT NULL"

# Recent Sportlink downloads
sqlite3 data/laposta-sync.sqlite "SELECT id, created_at FROM sportlink_runs ORDER BY id DESC LIMIT 5"

# Nikki contributions with outstanding balance
node tools/show-nikki-contributions.js --outstanding

# FreeScout customer count
sqlite3 data/freescout-sync.sqlite "SELECT COUNT(*) FROM freescout_customers WHERE freescout_id IS NOT NULL"

Deploying Updates

# On local machine: commit and push
git add . && git commit -m "description" && git push

# On server: pull and install
ssh [email protected] "cd /home/rondo && git pull && npm install"

Only run npm install if dependencies changed (check package.json diff).

Data Validation

Verify Rondo Club ID Mappings

Checks that all tracked rondo_club_id values still point to valid WordPress posts:

node tools/verify-rondo-club-data.js --verbose     # Report only
node tools/verify-rondo-club-data.js --fix --verbose  # Fix invalid IDs

Repopulate Missing Rondo Club IDs

If IDs were lost (e.g., database restored from backup):

node tools/repopulate-rondo-club-ids.js --dry-run --verbose  # Preview
node tools/repopulate-rondo-club-ids.js --verbose             # Apply

Validate Photo Consistency

Check that photo files on disk match database state:

node tools/check-photo-consistency.js --verbose   # Report
node tools/check-photo-consistency.js --fix       # Fix mismatches

Cleanup Operations

Remove Duplicate Members

node tools/delete-duplicates.js --verbose   # Dry run
node tools/delete-duplicates.js --apply      # Delete duplicates

Merge Duplicate Person Records

When a parent and member record exist for the same person:

node tools/merge-duplicate-person.js --parent=123 --member=456

Remove Orphaned Data

# Orphaned relationships
node tools/cleanup-orphan-relationships.js --verbose
node tools/cleanup-orphan-relationships.js --fix

# Duplicate relationships
node tools/cleanup-duplicate-relationships.js

Deduplicate Laposta Lists

node tools/dedupe-laposta-list.js              # Dry run, all lists
node tools/dedupe-laposta-list.js --apply      # Delete duplicates
node tools/dedupe-laposta-list.js 2 --apply    # List 2 only

Log Management

Logs accumulate in logs/cron/. Clean up old logs periodically:

# Delete logs older than 30 days
find logs/cron/ -name "*.log" -mtime +30 -delete

# Check disk usage
du -sh logs/

Monitoring Checklist

Daily checks:

• People sync email report arrives (4x daily)
• No errors in latest sync report

Weekly checks:

• Team sync ran on Sunday (check logs/cron/sync-teams-*)
• Full functions sync ran on Sunday (check logs/cron/sync-functions-*)
• Discipline sync ran on Monday (check logs/cron/sync-discipline-*)
• Disk usage reasonable (du -sh /home/rondo/)

Monthly checks:

• Log files cleaned up (find logs/cron/ -name "*.log" -mtime +30 | wc -l)
• Photo directory size reasonable (du -sh photos/)
• Database sizes stable (ls -lh data/*.sqlite)