Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Build your own search engine #62

Open
mre opened this issue Jul 3, 2020 · 0 comments
Open

Build your own search engine #62

mre opened this issue Jul 3, 2020 · 0 comments
Labels
level-intermediate topic-engineering topic-networking topic-patterns-and-idioms

Comments

@mre
Copy link
Member

mre commented Jul 3, 2020

What?

https://boyter.org/2013/01/code-for-a-search-engine-in-php-part-1/ in Rust

Why?

To learn about Rust idioms, performance, async, ...

How?

Plot twist: It's not a normal search engine for today's web, but one for the past.
Today's websites are expensive to crawl thanks to big file sizes and a lot of JS.
Instead, get the top 1 million websites from 2000 and crawl them through archive.org. 😉
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
level-intermediate topic-engineering topic-networking topic-patterns-and-idioms
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@mre