Commit 532e20db6e
Verified · cmc
Layout: unified · split
README.md added +106
| @@ -0,0 +1,106 @@ | |||
| 1 | [](https://deepwiki.com/ccleberg/crumb) | ||
| 2 | |||
| 3 | Crumb is a local-only browser history tracker. It consists of two parts: | ||
| 4 | a WebExtension-based browser plugin and a local HTTP server. Crumb logs | ||
| 5 | each visited web page to a plaintext file in Org-mode format. | ||
| 6 | |||
| 7 | # Components | ||
| 8 | |||
| 9 | - Browser extension (WebExtension API, JavaScript) | ||
| 10 | - Local HTTP listener (Python + Flask) | ||
| 11 | - Plaintext log file (~/.crumb/history.log) | ||
| 12 | |||
| 13 | # Functionality | ||
| 14 | |||
| 15 | Each time a page is loaded in the browser, the extension sends the page | ||
| 16 | metadata to the local server. The server appends this data to a | ||
| 17 | structured log file. | ||
| 18 | |||
| 19 | Data captured per page: | ||
| 20 | |||
| 21 | - Page title | ||
| 22 | - URL | ||
| 23 | - Timestamp (UTC) | ||
| 24 | - Hostname | ||
| 25 | - Path | ||
| 26 | - Optional: query string, tab ID, window ID, favicon URL | ||
| 27 | |||
| 28 | The log is formatted as an Org-mode file, with one top-level heading per | ||
| 29 | visit and standard `:PROPERTIES:` metadata. | ||
| 30 | |||
| 31 | # Requirements | ||
| 32 | |||
| 33 | - Python 3.x | ||
| 34 | - Flask | ||
| 35 | - A Chromium-based or Firefox browser with extension developer mode | ||
| 36 | enabled | ||
| 37 | |||
| 38 | # Usage | ||
| 39 | |||
| 40 | 1. Start the local listener: | ||
| 41 | |||
| 42 | ``` shell | ||
| 43 | python3 -m venv venv | ||
| 44 | source ./venv/bin/activate | ||
| 45 | pip install -r requirements.txt | ||
| 46 | python server.py | ||
| 47 | ``` | ||
| 48 | |||
| 49 | 2. Load the extension into your browser: | ||
| 50 | |||
| 51 | - Enable Developer Mode | ||
| 52 | - Load the `crumb_extension/` directory | ||
| 53 | |||
| 54 | 3. Browse the web. Entries will appear in `~/.crumb/history.org` | ||
| 55 | |||
| 56 | 4. Search the log using: | ||
| 57 | |||
| 58 | ``` shell | ||
| 59 | python search.py <term> | ||
| 60 | ``` | ||
| 61 | |||
| 62 | # Example Log Entry | ||
| 63 | |||
| 64 | ``` org | ||
| 65 | * Example Domain | ||
| 66 | :PROPERTIES: | ||
| 67 | :URL: http://example.com | ||
| 68 | :TIMESTAMP: 2025-06-04T20:31:01.123456 | ||
| 69 | :HOST: example.com | ||
| 70 | :PATH: / | ||
| 71 | :TAB: 143 | ||
| 72 | :WINDOW: 1 | ||
| 73 | :FAVICON: https://example.com/favicon.ico | ||
| 74 | :END: | ||
| 75 | ``` | ||
| 76 | |||
| 77 | # Preview Images | ||
| 78 | |||
| 79 | Screenshots of Crumb in use. | ||
| 80 | |||
| 81 | <figure> | ||
| 82 | <img src="./screenshots/devtools.png" /> | ||
| 83 | <figcaption>Developer Console Output</figcaption> | ||
| 84 | </figure> | ||
| 85 | |||
| 86 | <figure> | ||
| 87 | <img src="./screenshots/history.png" /> | ||
| 88 | <figcaption>Org-Mode History Log</figcaption> | ||
| 89 | </figure> | ||
| 90 | |||
| 91 | <figure> | ||
| 92 | <img src="./screenshots/search.png" /> | ||
| 93 | <figcaption>Search Utility in Terminal</figcaption> | ||
| 94 | </figure> | ||
| 95 | |||
| 96 | # Limitations | ||
| 97 | |||
| 98 | - Browser extensions cannot write files directly; communication requires | ||
| 99 | the local server. | ||
| 100 | - History is stored in plaintext and is not encrypted. You can bolt-on a | ||
| 101 | third-party encryption tool, if required. | ||
| 102 | - Data is stored locally and is never transmitted externally. | ||
| 103 | |||
| 104 | # License | ||
| 105 | |||
| 106 | GPL 3.0 License. See LICENSE file. | ||
README.org deleted −102
| @@ -1,102 +0,0 @@ | |||
| 1 | #+TITLE: Crumb | ||
| 2 | #+AUTHOR: Christian Cleberg | ||
| 3 | #+OPTIONS: toc:nil | ||
| 4 | |||
| 5 | [[https://deepwiki.com/ccleberg/crumb][https://deepwiki.com/badge.svg]] | ||
| 6 | |||
| 7 | Crumb is a local-only browser history tracker. It consists of two parts: a | ||
| 8 | WebExtension-based browser plugin and a local HTTP server. Crumb logs each | ||
| 9 | visited web page to a plaintext file in Org-mode format. | ||
| 10 | |||
| 11 | * Components | ||
| 12 | |||
| 13 | - Browser extension (WebExtension API, JavaScript) | ||
| 14 | - Local HTTP listener (Python + Flask) | ||
| 15 | - Plaintext log file (~/.crumb/history.log) | ||
| 16 | |||
| 17 | * Functionality | ||
| 18 | |||
| 19 | Each time a page is loaded in the browser, the extension sends the page metadata | ||
| 20 | to the local server. The server appends this data to a structured log file. | ||
| 21 | |||
| 22 | Data captured per page: | ||
| 23 | |||
| 24 | - Page title | ||
| 25 | - URL | ||
| 26 | - Timestamp (UTC) | ||
| 27 | - Hostname | ||
| 28 | - Path | ||
| 29 | - Optional: query string, tab ID, window ID, favicon URL | ||
| 30 | |||
| 31 | The log is formatted as an Org-mode file, with one top-level heading per visit | ||
| 32 | and standard =:PROPERTIES:= metadata. | ||
| 33 | |||
| 34 | * Requirements | ||
| 35 | |||
| 36 | - Python 3.x | ||
| 37 | - Flask | ||
| 38 | - A Chromium-based or Firefox browser with extension developer mode enabled | ||
| 39 | |||
| 40 | * Usage | ||
| 41 | |||
| 42 | 1. Start the local listener: | ||
| 43 | |||
| 44 | #+BEGIN_SRC shell | ||
| 45 | python3 -m venv venv | ||
| 46 | source ./venv/bin/activate | ||
| 47 | pip install -r requirements.txt | ||
| 48 | python server.py | ||
| 49 | #+END_SRC | ||
| 50 | |||
| 51 | 2. Load the extension into your browser: | ||
| 52 | |||
| 53 | - Enable Developer Mode | ||
| 54 | - Load the =crumb_extension/= directory | ||
| 55 | |||
| 56 | 3. Browse the web. Entries will appear in =~/.crumb/history.org= | ||
| 57 | |||
| 58 | 4. Search the log using: | ||
| 59 | |||
| 60 | #+BEGIN_SRC shell | ||
| 61 | python search.py <term> | ||
| 62 | #+END_SRC | ||
| 63 | |||
| 64 | * Example Log Entry | ||
| 65 | |||
| 66 | #+BEGIN_SRC org | ||
| 67 | * Example Domain | ||
| 68 | :PROPERTIES: | ||
| 69 | :URL: http://example.com | ||
| 70 | :TIMESTAMP: 2025-06-04T20:31:01.123456 | ||
| 71 | :HOST: example.com | ||
| 72 | :PATH: / | ||
| 73 | :TAB: 143 | ||
| 74 | :WINDOW: 1 | ||
| 75 | :FAVICON: https://example.com/favicon.ico | ||
| 76 | :END: | ||
| 77 | #+END_SRC | ||
| 78 | |||
| 79 | * Preview Images | ||
| 80 | |||
| 81 | Screenshots of Crumb in use. | ||
| 82 | |||
| 83 | #+CAPTION: Developer Console Output | ||
| 84 | [[./screenshots/devtools.png]] | ||
| 85 | |||
| 86 | #+CAPTION: Org-Mode History Log | ||
| 87 | [[./screenshots/history.png]] | ||
| 88 | |||
| 89 | #+CAPTION: Search Utility in Terminal | ||
| 90 | [[./screenshots/search.png]] | ||
| 91 | |||
| 92 | * Limitations | ||
| 93 | |||
| 94 | - Browser extensions cannot write files directly; communication requires the | ||
| 95 | local server. | ||
| 96 | - History is stored in plaintext and is not encrypted. You can bolt-on a | ||
| 97 | third-party encryption tool, if required. | ||
| 98 | - Data is stored locally and is never transmitted externally. | ||
| 99 | |||
| 100 | * License | ||
| 101 | |||
| 102 | GPL 3.0 License. See LICENSE file. | ||