penal-colony/kafka
2
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
60 commits 4 branches 0 tags 26 MiB
Commit graph

2 commits

Author SHA1 Message Date
Franz Kafka
471b9798e1 fix: regexp.DotAll flag in google engine and Metadata field removal
Some checks failed
Tests / test (push) Successful in 39s
Details
Build and Push Docker Image / build-and-push (push) Failing after 7s
Details
Mirror to GitHub / mirror (push) Failing after 3s
Details 
- google.go: use inline (?s) flag instead of regexp.DotAll second arg
- youtube.go: remove Metadata field (not in MainResult contract)
- config_test.go: fix expected engine count from 9 to 11 (google+youtube)
 2026-03-22 02:54:12 +00:00
Franz Kafka
7d23f13dfa feat: add Google engine using GSA User-Agent scraping 
SearXNG approach: use Google Search Appliance (GSA) User-Agent
pool — these are whitelisted enterprise identifiers Google trusts.

Key techniques:
- GSA User-Agent (iPhone OS + GSA/ version) instead of Chrome desktop
- CONSENT=YES+ cookie to bypass EU consent wall
- Parse /url?q= redirector URLs (unquote + strip &sa= params)
- div.MjjYud class for result containers (SearXNG selector)
- data-sncf divs for snippets
- detect sorry.google.com blocks
- Suggestions from ouy7Mc class cards
 2026-03-22 01:29:46 +00:00