reMarkable-tools

Tools for the reMarkable paper tablet that I or others develop.

Donate

Feel free to donate to me through paypal.me/pierrefenoll1
Make sure to describe what I should be working on :)

Whiteboard HyperCard ~ live collaboration/drawing/chat/whiteboarding

Easiest installation through toltec's opkg

opkg update && opkg install whiteboard-hypercard

Self-hosting whiteboard-server / hosting private rooms

On a machine with IP 1.2.3.4 reachable over the Internet, run:

git clone https://github.com/fenollp/reMarkable-tools.git && cd reMarkable-tools && make debug

Now on your tablet, run the whiteboard Rust application with --host, as in:

export WHITEBOARD_WEBHOST=http://1.2.3.4:10001/screenshare
.../whiteboard --host=http://1.2.3.4:10000

Finally, docker compose should show you something akin to:

nats_1        | [1] 2020/11/03 14:26:24.435123 [DBG] 172.20.0.3:60308 - cid:1 - Client Ping Timer
nats_1        | [1] 2020/11/03 14:26:24.435145 [DBG] 172.20.0.3:60308 - cid:1 - Delaying PING due to remote ping 2s ago
nats_1        | [1] 2020/11/03 14:28:22.270230 [TRC] 172.20.0.3:60308 - cid:1 - <<- [PING]
nats_1        | [1] 2020/11/03 14:28:22.270306 [TRC] 172.20.0.3:60308 - cid:1 - ->> [PONG]
nats_1        | [1] 2020/11/03 14:28:24.435532 [DBG] 172.20.0.3:60308 - cid:1 - Client Ping Timer
nats_1        | [1] 2020/11/03 14:28:24.435701 [DBG] 172.20.0.3:60308 - cid:1 - Delaying PING due to remote ping 2s ago
wb            | 2020-11-03T14:28:41.402Z	INFO	hypercard_whiteboard/rpc_recv_events.go:32	handling RecvEvent	{"": "c91dd90e-77b8-477c-94f7-a25ff0e5b584"}
wb            | 2020-11-03T14:28:41.402Z	DEBUG	hypercard_whiteboard/rpc_recv_events.go:46	listening for events	{"": "c91dd90e-77b8-477c-94f7-a25ff0e5b584", "bk": "hc.wb.1.evt.living-room.*.*"}
wb            | 2020-11-03T14:28:41.402Z	DEBUG	hypercard_whiteboard/nats.go:44	encoding	{"": "c91dd90e-77b8-477c-94f7-a25ff0e5b584", "event": {"created_at":1604413721402953665,"by_user_id":"c91dd90e-77b8-477c-94f7-a25ff0e5b584","in_room_id":"living-room","Event":{"UserJoinedTheRoom":true}}}
wb            | 2020-11-03T14:28:41.403Z	DEBUG	hypercard_whiteboard/nats.go:50	encoded	{"": "c91dd90e-77b8-477c-94f7-a25ff0e5b584", "bytes": 63, "in": "160.551µs"}
wb            | 2020-11-03T14:28:41.403Z	DEBUG	hypercard_whiteboard/nats.go:56	publishing	{"": "c91dd90e-77b8-477c-94f7-a25ff0e5b584", "rk": "hc.wb.1.evt.living-room.c91dd90e-77b8-477c-94f7-a25ff0e5b584.userjoinedroom"}
wb            | 2020-11-03T14:28:41.403Z	DEBUG	hypercard_whiteboard/nats.go:62	published	{"": "c91dd90e-77b8-477c-94f7-a25ff0e5b584", "rk": "hc.wb.1.evt.living-room.c91dd90e-77b8-477c-94f7-a25ff0e5b584.userjoinedroom", "in": "6.926µs"}
nats_1        | [1] 2020/11/03 14:28:41.403146 [TRC] 172.20.0.3:60308 - cid:1 - <<- [SUB hc.wb.1.evt.living-room.*.*  1]
nats_1        | [1] 2020/11/03 14:28:41.403446 [TRC] 172.20.0.3:60308 - cid:1 - <<- [PUB hc.wb.1.evt.living-room.c91dd90e-77b8-477c-94f7-a25ff0e5b584.userjoinedroom 63]
nats_1        | [1] 2020/11/03 14:28:41.403472 [TRC] 172.20.0.3:60308 - cid:1 - <<- MSG_PAYLOAD: ["\b\xc1\x9f\xf1\x87\xf7\xb8\x81\xa2\x16\x12$c91dd90e-77b8-477c-94f7-a25ff0e5b584\x1a\vliving-room0\x01"]
nats_1        | [1] 2020/11/03 14:28:41.403491 [TRC] 172.20.0.3:60308 - cid:1 - ->> [MSG hc.wb.1.evt.living-room.c91dd90e-77b8-477c-94f7-a25ff0e5b584.userjoinedroom 1 63]
wb            | 2020-11-03T14:28:41.404Z	DEBUG	hypercard_whiteboard/rpc_recv_events.go:100	sent count event	{"": "c91dd90e-77b8-477c-94f7-a25ff0e5b584", "in": "73.035µs"}

koreader

• https://github.com/koreader/koreader/releases/latest
• instructions: https://github.com/koreader/koreader/wiki/Installation-on-Remarkable
• creates metadata files:

find ~ -name '*.sdr'

Tools

• cbr2cbz.sh *.cbr unrars then zips CBRs into CBZs so koreader can open them.
• rsync on the tablet:
  1. wget https://raw.githubusercontent.com/Evidlo/remarkable_entware/master/entware_install.sh && chmod +x entware_install.sh
  2. opkg install rsync
  3. And because ssh remarkable 'echo $PATH' #=> /usr/bin:/bin
  4. ln -s which rsync /usr/bin/

Attention

Updates wipe ~

root partition is small

remarkable: ~/ df -h
Filesystem                Size      Used Available Use% Mounted on
/dev/root               223.0M    175.0M     32.3M  84% /

so routinely run

journalctl --vacuum-size=2M

HyperCards

Visible rectangular elements that can be drawn on/dragged/zoomed/rotated/connected/duplicated.

• tools / modifiers are square cards snapping to the edges of the screen
  • henceforth mentioned as [ToolX] for tool X
  • using them / modifying them by a press held while using the pencil * similar to Minecraft's mix & match: action through combination
  • a [?] tool always hangs in a corner, pressing = shows description text (like crosswords)
  • modification (reorganization / addition / removal) through drawing and pressing
  • tools icons can be drawn too / loaded from a font / loaded from a builtin set of images
  • pen & fingers are different devices for different purposes
    • => drag/move and pinch/zoom (think Apple trackpad gestures) not a pen thing
• whiteboard card
  • rectangle that can be moved by dragging on the edges
  • zoom/rotation by dragging in the area (not the edges)
    • MIGHT: zooming hard moves to another user's view? --> canvas is a window/camera view that can move in 2+1D
  • some bi-directional communication with a networked service
    • user joins a room and shares their live drawings
    • It is possible to combine a [Selection]-ed group of strokes and [Digitize] to ask service for translation
• [Digitize]
  • connects to a distant machine or achieves its AI inference on-tablet
  • takes a few strokes in and outputs text+area / shape+area
• [Selection]
  • draw approximately on one or more strokes
  • creates a group that can be used with other modifiers
  • press another tool before unpressing this one to pass the group to the other tool
• [Image]
  • add an image to a layer
    • should be able to dim that layer
  • select the tool's image with [Setter] > [Image] --> opens image picker
  • image should be draggable + zoomable (= two-finger gesture on iOS Reddit app's image viewer)
    • should be able to draw on top of said image

marauder

• 

• https://github.com/ax3l/lines-are-rusty

  • https://github.com/reHackable/maxio/blob/master/tools/rM2svg

• datasets & models for online writting & drawings

  • task: HTR = Handwriting Text Recognition
  • https://quickdraw.withgoogle.com
  • https://archive.ics.uci.edu/ml/datasets/UJI+Pen+Characters
    • https://archive.ics.uci.edu/ml/datasets/Pen-Based+Recognition+of+Handwritten+Digits
  • 19, TextCaps : Handwritten Character Recognition with Very Small Datasets
  • 19, RNN-based Online Handwritten Character Recognition Using Accelerometer and Gyroscope Data
  • https://www.gavo.t.u-tokyo.ac.jp/~qiao/database.html
  • ICFHR: International Conference on Frontiers in Handwriting Recognition
  • https://en.wikipedia.org/wiki/List_of_datasets_for_machine-learning_research#Handwriting_and_character_recognition
  • https://mathpix.com/

• https://github.com/dickrnn/dickrnn.github.io

• https://github.com/tonybeltramelli/pix2code

• https://crates.io/crates/eliza

• https://parl.ai/projects/recipes

• https://billwadge.wordpress.com/2020/04/20/the-intensional-spreadsheet

• https://github.com/lisbravo/MNIST-drawing-test

• https://www.myscript.com/

  • https://github.com/MyScript/interactive-ink-examples-ios
  • https://github.com/CocoaPods/Specs/blob/master/Specs/f/c/3/MyScriptInteractiveInk-Runtime

• untools: Tools for better thinking

• TRIZ: theory of inventive problem solving

• Stop Taking Regular Notes; Use a Zettelkasten Instead

• DeepSVG: A Hierarchical Generative Network for Vector Graphics Animation

• Using GANs to Create Fantastical Creatures

• https://github.com/MarkMoHR/Awesome-Sketch-Based-Applications

• https://github.com/topics/drawing

• Sketch-Based-Deep-Learning

  • 
  • BézierSketch: A generative model for scalable vector sketches
  • Sketch-R2CNN: An Attentive Network for Vector Sketch Recognition

• Detecting hand drawn flowcharts

• Deep Sketch-guided Cartoon Video Synthesis

• CoSE: While previous approaches rely on sequence-based models for drawings of basic objects or handwritten text, we propose a model that treats drawings as a collection of strokes

• https://github.com/MarkMoHR/Awesome-Sketch-Synthesis

• https://github.com/topics/vector-sketch

  • Animated Construction of Line Drawings
    • Contour Drawing Dataset / Photo-Sketching: Inferring Contour Drawings from Images
  • Scones: Towards Conversational Authoring of Sketches
  • Free-hand sketch synthesis with deformable stroke models
  • Convert images to vectorized line drawings for plotters.

• Draw.io and Terraform = Brainboard, Graphical Way to Do Terraform

• Handwrite generates a custom font based on your handwriting sample

• Potrace: Transforming bitmaps into vector graphics

• 21, Im2Vec: Synthesizing Vector Graphics without Vector Supervision

• 

• Create single line SVG illustrations from your pictures

• Show HN: Tool that turns your images into plotter-like line drawings

• Pipes and Paper: Ancient Abstractions (or: hacking my ReMarkable tablet into a live presentation tool)

• EasyOCR is a python module for extracting text from image

• Plan2Scene: Converting Floorplans to 3D Scenes

• 

• Protein Ribbon Diagrams

• code for generating topographic contour maps

• construct tilings of regular polygons and their dual

  • https://en.wikipedia.org/wiki/List_of_Euclidean_uniform_tilings

• 

• Turtle graphics is a key feature of the Logo programming language

• 

• A088218: Total number of leaves in all rooted ordered trees with n edges

• https://mlajtos.mu/posts/new-kind-of-paper

• n8n: node based Workflow Automation Tool

• CHAIKIN’S ALGORITHM – DRAWING CURVES

• armrest: handwriting recognition + Elm-inspired UI library

• https://www.reddit.com/r/Handwriting_Analysis/

• demo: offline OCR with Tesseract

• Chalktalk is a digital presentation and communication language in development at New York University's Future Reality Lab

• resvg 0.7 - an SVG rendering library

  • https://github.com/RazrFalcon/svgtypes/tree/master/fuzz
  • https://github.com/RazrFalcon/resvg

• librecalibrate button example

• Pyflow: visual and modular block programming

• https://store.steampowered.com/app/619150/while_True_learn/

• rete: visual programming and creating node editor

• https://blockprotocol.org/hub

• A procedural, node-based modelling tool, made in rust

  • https://github.com/setzer22/egui_node_graph

• remarkable chemist app: draw molecules on a hex grid so it renders 3d views

• favorite browser-based creative arts tools/playthings that use AI or Machine Learning

• devices

  • Ratta Supernote
  • HUAWEI MatePad Paper
  • PineNote
  • Reinkstone R1

• forget-me-node: draw lines, get flowers

• savage: A primitive computer algebra system

• FEA in order to simulate physical phenomena in the VIRTUAL world

• 19, Shrubbery-shell inspired 3D model stylization

• StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis

• λ-2D: An Exploration of Drawing as Programming Language, Featuring Ideas from Lambda Calculus

• skastic: Visual programming language: SKetches of Abstract Syntax Trees. I. C.

• Mental Canvas: demo

  • https://www.mentalcanvas.com/

• 

• https://www.louisbouchard.ai/editgan/

• https://mrdoob.com/projects/harmony/

• Appearance-preserving manipulation of hand-drawn graphs

  • 2015, Hand-Drawn Graph Problems in Online Education

• https://github.com/MarkMoHR/Awesome-Sketch-Based-Applications

• GitHub: Creating Mermaid diagrams

• Simulate dynamic systems expressed in block diagram form using Python

• convert hand-drawn circuit to computer schematic

• hand-drawn schematic sketch recognizer and converter

• https://github.com/MarkMoHR/Awesome-Sketch-Synthesis

• General Virtual Sketching Framework for Vector Line Art (SIGGRAPH 2021)

• Recognition of handwritten flowcharts using CNNs to generate C

• rLCD devices

  • HannsNote2 10"
  • Sun Vision Display 32”

• color Kobo https://fr.kobobooks.com/products/kobo-libra-colour

• tsyncs: task synchronization simulator

  • Web demo (also, native)

• Hellish workflows

  • 5b0872a5666fec9b7bb6fd623c431de03263372d.jpeg
  • blueprintsfromhell
  • scriptsofanotherdimension

• Handwritten Sequence Trajectories

  • 2018, Handwriting Trajectory Recovery using End-to-End Deep Encoder-Decoder Network
  • Extending the Handwritten Character Omniglot Challenge https://github.com/CognitiveModeling/DigiLeTs?tab=readme-ov-file#missing-pressure-values-extrapolation-and-sampling
  • dataset results for Handwriting Recognition AND Time series
  • 2023, Strokes Trajectory Recovery for Unconstrained Handwritten Documents with Automatic Evaluation
  • 2022, Benchmarking Online Sequence-to-Sequence and Character-based Handwriting Recognition from IMU-Enhanced Pens