penal-colony/kafka
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
kafka/internal/engines
History
Franz Kafka 7d23f13dfa feat: add Google engine using GSA User-Agent scraping 
SearXNG approach: use Google Search Appliance (GSA) User-Agent
pool — these are whitelisted enterprise identifiers Google trusts.

Key techniques:
- GSA User-Agent (iPhone OS + GSA/ version) instead of Chrome desktop
- CONSENT=YES+ cookie to bypass EU consent wall
- Parse /url?q= redirector URLs (unquote + strip &sa= params)
- div.MjjYud class for result containers (SearXNG selector)
- data-sncf divs for snippets
- detect sorry.google.com blocks
- Suggestions from ouy7Mc class cards
2026-03-22 01:29:46 +00:00
..
arxiv.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
arxiv_test.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
bing.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
bing_test.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
braveapi.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
braveapi_test.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
crossref.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
crossref_test.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
duckduckgo.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
duckduckgo_parse.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
duckduckgo_test.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
engine.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
factory.go feat: add Google engine using GSA User-Agent scraping 2026-03-22 01:29:46 +00:00
github.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
github_test.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
google.go feat: add Google engine using GSA User-Agent scraping 2026-03-22 01:29:46 +00:00
html_helpers.go feat: add DuckDuckGo, GitHub, Reddit, and Bing engines 2026-03-21 16:52:11 +00:00
http_mock_test.go feat: build Go-based SearXNG-compatible search service 2026-03-20 20:34:08 +01:00
planner.go feat: add Google engine using GSA User-Agent scraping 2026-03-22 01:29:46 +00:00
qwant.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
qwant_lite_test.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
qwant_test.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
reddit.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
reddit_test.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
wikipedia.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00
wikipedia_test.go chore: update Go module path to github.com/metamorphosis-dev/kafka 2026-03-21 19:42:01 +00:00