penal-colony/kafka
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
58 commits 5 branches 0 tags 26 MiB
Commit graph

58 commits

This branch
This branch
All branches
Author SHA1 Message Date
Franz Kafka
4c54ed5b56 feat: add multi-stage Dockerfile and docker-compose.yml 
- Multi-stage Dockerfile: golang:1.24-alpine builder → alpine:3.21 runtime
  - CGO_ENABLED=0 for static binary, stripped with -ldflags="-s -w"
  - Only copies ca-certificates and tzdata to runtime image
  - Config via volume mount at /etc/gosearch/config.toml
- docker-compose.yml: gosearch + Valkey 8
  - Valkey healthcheck ensures gosearch starts after cache is ready
  - Persistent Valkey volume
  - config.toml mounted read-only
- Update .gitignore with Go build artifacts
 2026-03-21 15:46:33 +00:00
Franz Kafka
94322ceff4 feat: Valkey cache for search results 
- Add internal/cache package using go-redis/v9 (Valkey-compatible)
- Cache keys are deterministic SHA-256 hashes of search parameters
- Cache wraps the Search() method: check cache → miss → execute → store
- Gracefully disabled if Valkey is unreachable or unconfigured
- Configurable TTL (default 5m), address, password, and DB index
- Environment variable overrides: VALKEY_ADDRESS, VALKEY_PASSWORD,
  VALKEY_DB, VALKEY_CACHE_TTL
- Structured JSON logging via slog throughout cache layer
- Refactored service.go: extract executeSearch() from Search() for clarity
- Update config.example.toml with [cache] section
- Add cache package tests (key generation, nop behavior)
 2026-03-21 15:43:47 +00:00
Franz Kafka
385a7acab7 feat: concurrent engine execution with graceful degradation 
- Run all local engines in parallel using goroutines + sync.WaitGroup
- Individual engine failures are captured as unresponsive_engines entries
  instead of aborting the entire search request
- Context cancellation is respected: cancelled engines report as unresponsive
- Upstream proxy failure is also gracefully handled (single unresponsive entry)
- Extract unresponsiveResponse() and emptyResponse() helpers for consistency
- Add comprehensive tests:
  - ConcurrentEngines: verifies parallelism (2x100ms engines complete in ~100ms)
  - GracefulDegradation: one engine fails, one succeeds, both represented
  - AllEnginesFail: no error returned, all engines in unresponsive_engines
  - ContextCancellation: engine respects context timeout, reports unresponsive
 2026-03-21 15:39:00 +00:00
Franz Kafka
5181073a95 fix: clear env vars in TestLoadFromFile to test pure config values 
The sandbox had BRAVE_API_KEY set, causing the env override to win
over the config file value in the test assertion.
 2026-03-21 15:34:06 +00:00
Franz Kafka
8649864971 feat: migrate from env vars to config.toml 
- Add internal/config package with TOML parsing (BurntSushi/toml)
- Create config.example.toml documenting all settings
- Update main.go to load config via -config flag (default: config.toml)
- Environment variables remain as fallback overrides for backward compat
- Config file values are used as defaults; env vars override when set
- Add comprehensive tests for file loading, defaults, and env overrides
- Add config.toml to .gitignore (secrets stay local)
 2026-03-21 14:56:00 +00:00
Franz Kafka
dc44837219 feat: build Go-based SearXNG-compatible search service 
Implement an API-first Go rewrite with local engine adapters, upstream fallback, and Nix-based tooling so searches can run without matching the original UI while preserving response compatibility.

Made-with: Cursor
 2026-03-20 20:34:08 +01:00
Franz Kafka
7783367c71 chore: update gitignroe 2026-03-20 17:15:36 +01:00
Franz Kafka
d2ca4190a3 first commit 2026-03-20 17:14:32 +01:00