OSF Crawler Cooperation
Support Infrastructure for Open Search initiatives
The Open Search Foundation (OSF) attempts to build a European main stream search engine alternative, under European regulations like privacy and fair participation. Our project builds on the foundations of that OSF search engine to be, in an attempt to combine existing crawling efforts of OSF participants. This is implemented on the real internet scale: petabytes of data, billions of webpages, a hundred million websites with terabytes of communication between the components per day. The scale and regulations call for a concept which has not been implemented before. Existing web-search related projects are invited to contribute their ideas into our larger concept, which could become not just an alternative for Google Search but also has many other uses - even in early stages.
- The project's own website: https://skrodon.eu/
Run by MarkOv Solutions
This project was funded through the NGI0 Discovery Fund, a fund established by NLnet with financial support from the European Commission's Next Generation Internet programme, under the aegis of DG Communications Networks, Content and Technology under grant agreement No 825322.
