Script to fetch webcomics, archive them and use them to create ebooks.
Web crawlers are defined to retrieve comic information and store them into files. This can then be used to generated ebooks.
These webcrawlers are supposed to be easy to write with a minimal amount of boilerplate code whilst trying to keep some flexibility.
Under the hood, there is one class per webcrawler, each of them inherits, directly or not, from an abstract class GenericComic which handles all the common logic. Each webcrawler just needs to provide specific information (name and url) and a way to get the comics after a given one (if any) which is done by implementing the get_next_comic generator.
Other abstract classes, inheriting from GenericComic provide a convenient way to define get_next_comic. The most common is GenericNavigableComic, used for comics where next/previous strips are available using the relevant link.
The whole project relies heavily on BeautifulSoup.
comicbookmaker.py takes multiple arguments.
--comic(or-c) can be used to tell which comic(s) is/are to be considered (defaults to all of them).--action(or-a) specifies which actions are to be performed on these comics : update (default behavior), book, etc.
dosage is a project with similar purpose. It seems to be a very nice project but it doesn't handle ebooks generation.
Feel free to open issues/open pull requests/ask questions/give comments.
Here is the little to know before contributing :
- license is MIT
- all pep8 rules apply except for the length of the lines
- 1111 Comics
- 1111 Comics (from Tapas.io)
- 1111 Comics (from Tumblr)
- 3MB Comics
- Abstruse Goose
- Tales of Absurdity
- Tales of Absurdity (from Tapas.io)
- Tales of Absurdity (from Tumblr)
- Absurdo
- Alex Levesque
- Angry At Nothing
- Angry At Nothing (from Tapas.io)
- Angry At Nothing (from Tumblr)
- Anomaly Town (from Tumblr)
- Anything Comic
- Anything Comic (from Tapas.io)
- Argyle Sweater
- Amazing Super Powers
- At Random Comics
- Aurel
- Space Avalanche
- Avventura
- Ma vie est tout a fait fascinante (Bagieu)
- Banana Twinky
- BarteNerds (from Tapas.io)
- Becks Comics
- Becks Comics (from Tapas.io)
- Jim Benton
- Berkeley Mews
- Berkeley Mews (from GoComics)
- Berkeley Mews (from Tumblr)
- BFGFS (from Tapas.io)
- BFGFS (from Tumblr)
- Big Foot Justice
- Big Foot Justice (from Tapas.io)
- Biter Comics
- Blazers At Dawn
- Every Day Blues
- Books of Adam
- Boulet Corp
- Boulet Corp (from Tumblr)
- Boulet Corp English
- Boumeries (from Tumblr)
- Boumeries (En)
- Boumeries (Fr)
- Break Of Day
- Brevity
- Brooklyn Cartoons (from Tumblr)
- BuniComics
- Electric Bunny Comic
- Electric Bunny Comic (from Tumblr)
- ButterSafe
- Calvin and Hobbes
- Calvin and Hobbes (from GoComics)
- Cancer Owl (from Tumblr)
- Is It Canon (from Tapas.io)
- Cassandra Calin (from Tapas.io)
- Cassandra Calin (from Tumblr)
- Catana
- Caw4hw (from Tapas.io)
- Caw4hw (from Tumblr)
- Channelate
- Cheese Cornz (from Tumblr)
- Chuckle-A-duck
- Cinismo Ilustrado
- Victims Of Circumsolar
- Victims Of Circumsolar (from Tumblr)
- A Comik
- Commit Strip (En)
- Commit Strip (Fr)
- Over Compensating
- Completely Serious Comics
- consolia
- Joan Cornella (from Tumblr)
- Cowardly Comics (from Tapas.io)
- Cowardly Comics (from Tumblr)
- C Est Pas En Regardant Ses Pompes (...)
- Cube Drone
- Cheer Up Emo Kid (from Tapas.io)
- Cheer Up Emo Kid (from Tumblr)
- Les Culottees
- Cyanide and Happiness
- Dagsson Hugleikur (from Tumblr)
- Dakota McDadzean
- Deadly Panel
- Deadly Panel (from Tapas.io)
- Deadly Panel (from Tumblr)
- Death Bulge
- Deep Dark Fears (from Tumblr)
- Depressed Alien
- According To Devin
- Mr Ethan Diamond
- Dilbert
- Dilbert Classics (from GoComics)
- Ali Dilem
- Dinosaur Comics
- Disco Bleach
- How DNS works
- The Dog House Diaries
- Dogmo Dog
- Don't Be Dad (from Tapas.io)
- Doodle For Food
- Doodle For Food (from Tapas.io)
- Dorris Mc
- Dorris Mc (from GoComics)
- Doug Was Taken
- Dustinteractive
- The Earth Explodes
- Eat My Paint
- Eat My Paint (from Tapas.io)
- Eat My Paint (from Tumblr)
- Extra Fabulous Comics
- Extra Fabulous Comics (from Tumblr)
- Safely Endangered
- Safely Endangered (from Tumblr)
- Eve Velo - chroniques du velotaf
- My Extra Life
- False Knees (from Tapas.io)
- False Knees (from Tumblr)
- Fat Awesome
- Fat Awesome (from Tumblr)
- The World Is Flat (from Tapas.io)
- The World Is Flat (from Tumblr)
- floccinaucinihilipilification
- Au fond du trou
- Cartooning For Peace
- Fowl Language Comics (from GoComics)
- Fowl Language Comics (from Tapas.io)
- Fowl Language Comics (from Tumblr)
- FoxTrot
- FoxTrot Classics
- Mrs Frollein (from Tumblr)
- Garfield
- Garfield (from GoComics)
- Geek And Poke
- Gemma Correll (from Tumblr)
- The Gentleman Armchair
- Gerbil With A Jetpack
- Glory Owl
- Good Bear Comics (from Tumblr)
- Xavier Gorce
- The Grohl Troll
- Chris Hallback (from Tumblr)
- Chris Hallback - The Book of Biff (from Tapas.io)
- Chris Hallback - Maximumble (from Tapas.io)
- Chris Hallback - Minimumble (from Tapas.io)
- A Hamm A Day
- Happle Tea
- Hark A Vagrant (from Tumblr)
- Heck if I Know comics (from Tapas.io)
- Heck if I Know comics (from Tumblr)
- Hit and Miss Comics
- HM Blanc
- Hoomph
- Horovitz (from Tumblr)
- Horovitz Classic
- Horovitz New
- Hot Comics For Cool People (from Tapas.io)
- Hot Comics For Cool People (from Tumblr)
- How HTTPS works
- Huffy Penguin
- Ice Cream Sandwich Comics
- Imogen Quest
- Imogen Quest (from GoComics)
- Imogen Quest (from Tumblr)
- Incidental Comics (from Tumblr)
- Infinite Guff
- Infinite Immortal Bens (from Tapas.io)
- Infinite Immortal Bens (from Tumblr)
- Invisible Bread
- In Your Face Cake (from Tapas.io)
- In Your Face Cake (from Tumblr)
- Irwin Cardozo
- It Fools A Monster
- Jake Likes Onions
- James Of No Trades (from Tapas.io)
- James Of No Trades (from Tumblr)
- The Jenkins
- My Jet Pack
- Jhall Comics (from Tumblr)
- Joey Alison Sayers (from GoComics)
- Julia's Drawings
- Just Say Eh
- Just Say Eh (from Tapas.io)
- Kickstand Comics featuring Yehuda Moon
- For Lack Of A Better Comic
- Last Place Comics
- Leleoz (from Tapas.io)
- Leleoz (from Tumblr)
- LibraryComic (from Tumblr)
- Little Life Lines
- Little Life Lines (from Tumblr)
- Light Roast Comics
- Light Roast Comics (from Tapas.io)
- L.I.N.S. Editions
- L.I.N.S. Editions (from Tumblr)
- Loading Artist
- Lol Nein (from Tumblr)
- Mike Luckovich
- Lunar Baboon
- Une Annee au Lycee
- Macadam Valley
- Lisa Mandel (HP, hors-service)
- Man Versus Manatee
- Marketoonist
- The Meerkatguy
- Mercworks
- Mercworks (from Tapas.io)
- Mercworks (from Tumblr)
- Micael (L'Air du temps)
- Lonnie Millsap
- Mister & Me
- Mister & Me (from GoComics)
- Mister & Me (from Tapas.io)
- Art By Moga
- Momentum (from Tapas.io)
- Infinite Monkey Business
- Monkey User
- Moon Beard
- Moon Beard (from Tumblr)
- Tu Mourras Moins Bete
- Mouse Bear Comedy
- Mouse Bear Comedy (from Tumblr)
- Mr. Lovenstein
- Mr. Lovenstein (from Tapas.io)
- NamelessPCs (from Tapas.io)
- Morgan Navarro (Ma vie de reac)
- NeDroid
- Nelluc Nhoj
- Nick Anderson
- Non Sequitur
- Nothing Suspicious
- Comic Nuggets
- The Oatmeal (from Tumblr)
- The Obscure Gentlemen
- Octopuns
- Octopuns (from Tumblr)
- Off The Leash Dog
- Off The Leash Dog (from Tumblr)
- Off The Mark
- Oglaf [NSFW]
- One Giant Hand
- Optipess
- Endless Origami
- Origami Hot Dish
- Oscillating Profundities
- Owl Turd / Shen Comix (from GoComics)
- Owl Turd / Shen Comix (from Tapas.io)
- Owl Turd / Shen Comix (from Tumblr)
- Pain Train Comics
- Pain Train Comics (from Tumblr)
- Perry Bible Fellowship
- Peanuts
- Pearls Before Swine
- Pear-Shaped Comics
- Penmen
- Peter Lauris
- PhD Comics
- Pictures in Boxes
- Pictures in Boxes (from GoComics)
- Pictures in Boxes (from Tumblr)
- Pie Comic
- The Pigeon Gazette (from Tapas.io)
- The Pigeon Gazette (from Tumblr)
- Pizza Dad (from Tapas.io)
- Plan C
- Plantu
- Pleasant Thoughts
- A Pleasant Waste Of Time (from Tapas.io)
- A Pleasant Waste Of Time (from Tumblr)
- Pom Comics / Piece of Me
- Pond Scum
- Poorly Drawn Lines
- Poorly Drawn Lines (from Tumblr)
- Yesterday's Popcorn (from Tapas.io)
- Yesterday's Popcorn (from Tumblr)
- Pretends to be drawing
- Pretends to be drawing (from Tapas.io)
- Pundemonium
- The Quark Side (from Tumblr)
- Quarktees
- Rae the Doe
- Rae the Doe (from Tumblr)
- Ted Rall
- Ted Rall (from GoComics)
- Michael Ramirez
- Random Crab
- RandoWis (from Tapas.io)
- Classic Randy
- Gone Into Rapture
- Gone Into Rapture (from Tapas.io)
- Respawn Comic
- Respawn Comic (from Tapas.io)
- Respawn Comic (from Tumblr)
- Robbie And Bobby (from Tumblr)
- Robospunk
- Robotatertot (from Tumblr)
- Mandatory Roller Coaster
- Rory (from Tapas.io)
- Rory (from Tumblr)
- Rock Paper Cynic (from Tapas.io)
- Rock Paper Cynic (from Tumblr)
- Rock Paper Scissors
- Rustled Jimmies
- Sarah Andersen (from GoComics)
- Sarah Andersen (from Tapas.io)
- Scandinavia And The World
- Savage Chicken (from GoComics)
- Sephko
- Sheldon Comics
- Sheldon Comics (from GoComics)
- Shitfest
- Sinewyn (from Tumblr)
- Skeleton Claw
- Small Blue Yonder (from Tapas.io)
- Saturday Morning Breakfast Cereal
- Saturday Morning Breakfast Cereal (from GoComics)
- Saturday Morning Breakfast Cereal (from Tumblr)
- Something Of That Ilk
- SPF Comics
- Down the Upward Spiral (from Tapas.io)
- Down the Upward Spiral (from Tumblr)
- Things in squares
- Sticky Cinema Floor
- Make it stoopid
- Everything's Stupid
- Everything's Stupid (from Tapas.io)
- Sunny Street
- Our Super Adventure (from Tapas.io)
- Our Super Adventure (from Tumblr)
- System Comic
- Shanghai Tango
- The Ism
- The Odd 1s Out (from Tapas.io)
- The Odd 1s Out (from Tumblr)
- These Inside Jokes (from Tumblr)
- They Can Talk
- Thor's Thundershack
- Thor's Thundershack (from Tapas.io)
- Three Word Phrase
- Three Word Phrase (from Tumblr)
- It's the tie
- It's the tie (from Tapas.io)
- It's the tie (from Tumblr)
- Time Trabble (from Tumblr)
- Tizzy Stitch Bird (from Tapas.io)
- Tizzy Stitch Bird (from Tumblr)
- Tom Toles
- Toon Hole
- Toon Hole (from Tapas.io)
- Tubey Toons
- Tubey Toons (from Tapas.io)
- Tubey Toons (from Tumblr)
- Tumble Dry (from Tapas.io)
- Turn Off Us
- Twisted Doodles
- Ubertool
- Ubertool (from Tapas.io)
- Ubertool (from Tumblr)
- The Underfold (from Tumblr)
- Unearthed Comics
- Unearthed Comics (from Tapas.io)
- Unearthed Comics (from Tumblr)
- Up And Out (from Tumblr)
- Up And Out (from Tapas.io)
- As Per Usual (from Tapas.io)
- As Per Usual (from Tumblr)
- Vector Belly
- Vegetables For Dessert
- Vidberg - l'actu en patates
- Verbal Vomit (from Tumblr)
- Waffles And Pancakes
- War And Peas
- War And Peas (from Tumblr)
- Warehouse Comic
- Webcomic Name
- We Flaps (from Tumblr)
- Will 5:00 Never Come ?
- Wondermark
- Wooden Plank Studios
- Work Chronicles
- Matt Wuerker
- WuMo
- xkcd
- The Awkward Yeti
- The Awkward Yeti (from GoComics)
- The Awkward Yeti (from Tapas.io)
- The Awkward Yeti (from Tumblr)
- Zen Pencils
- Zen Pencils (from Tumblr)
- Zep World
- Znoflats Comics