Page 1 of 1
YaCy search engine?
Posted: 01 Jun 2018 12:29
by Obfuscate
I am trying to run a YaCy search engine to index i2p network, I have already indexed 11k urls.
But I guess that there are a few existed i2p yacy search engines.
if so, I wanna know how to join them? And how to configure YaCy correctly to provide an interface for others?
Re: YaCy search engine?
Posted: 02 Jun 2018 08:55
by wed
There have been yacy search sites in the past on i2p (ike find4me.i2p), but to my best knowledge they are all down by now.
Would be nice to have an additional search engine, and above all, please publish how you did it on
http://i2pwiki.i2p/index.php?title=YaCy
Might be that others are encouraged to set up their own if they have a description how to do it.
Cheers
wed
Re: YaCy search engine?
Posted: 03 Jun 2018 00:58
by Obfuscate
Hi
The method is to set yacy to use i2p httpproxy.
Then start crawl from a single eepsite(for example, inr.i2p), and set crawl depth to 4 or more. So in that way, it started to work.
Now I have indexed more than 23k urls.
But the problem that I haven't solved is how to separate search interface from administration interface.Or maybe there will be more yacy clients, each uses its own search interface, and connects others through i2p(like that yacy p2p network in clearnet?)(I don't know how to do this now, either.)
Obfuscate
Re: YaCy search engine?
Posted: 05 Jun 2018 16:29
by zlatinb
Obfuscate wrote: ↑03 Jun 2018 00:58
But the problem that I haven't solved is how to separate search interface from administration interface.
You can curl the rss endpoint as shown here
https://yacy.net/en/API.html and then you'll have to write some parsing code and build your own search interface.
Re: YaCy search engine?
Posted: 05 Jun 2018 18:21
by zlatinb
Also, checkout
http://zzz.i2p/topics/641-how-to-config ... r-e-g-yacy for instructions how to configure router with Yacy and how to remove unwanted information from the User-Agent header.
Re: YaCy search engine?
Posted: 06 Jun 2018 12:19
by Obfuscate
OK, I will have look. Thank you very much.
More works will be done in 10 days.