high CPU utilization by tracker-store ,tracker- extract flooding /var/log/messages with errors

[atchik6056]

Hello
I am running

user@lysmarine:~ $ cat /etc/bbn-build
2023-07-23 18:29:49+00:00
user@lysmarine:~ $ cat /etc/*rel*
PRETTY_NAME="Debian GNU/Linux 11 (bullseye)"
NAME="Debian GNU/Linux"
VERSION_ID="11"
VERSION="11 (bullseye)"
VERSION_CODENAME=bullseye
ID=debian

I noticed a high CPU utilisation by tracker-extract tracker-store

 
┌nmon─16k─────────────────────Hostname=lysmarine────Refresh= 4secs ───12:58.43─┐
│ CPU Utilisation ─────────────────────────────────────────────────────────────│
│---------------------------+-------------------------------------------------+│
│CPU User%  Sys% Wait%  Idle|0          |25         |50          |75       100|│
│  1  87.0   3.0   1.0   9.0|UUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUs     >│
│  2  64.9   4.0   0.0  31.1|UUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUUss               >│
│  3  32.5   4.2   0.5  62.7|UUUUUUUUUUUUUUUUss                               >│
│  4  14.1   7.4   4.6  73.8|UUUUUUUsssWW                                     >│
│---------------------------+-------------------------------------------------+│
│Avg  49.9   4.7   1.5  43.9|UUUUUUUUUUUUUUUUUUUUUUUUss         >             |│
│---------------------------+-------------------------------------------------+│
│ Top Processes Procs=323-mode=3-1=Base 3=Perf 4=Size 5=I/O[RootOnly] u=Args───│
│  PID    %CPU  Size   Res   Res   Res   Res Shared   Faults  Command          │
│          Used    KB   Set  Text  Data   Lib    KB  Min  Maj                  │
│   99583  90.4  2146m  184m  128   399m    0  6860   29    2 tracker-extract  │
│    3128  86.4   368m39228   196 87396     0  3836 1227    4 tracker-store    │
│     793  10.2   203m10680   880 52432     0  1692    0    0 AIS-catcher      │
│     835   6.2  2616m23104  4884   527m    0  5680   19    0 python3          │
│     655   3.2   204m 5936  4884   143m    0  3412    0    0 pypilot          │
│     827   2.2  5444m40996 77480   358m    0 11720   55    0 node             │
│    1283   2.0 27192  4540  4884 13180     0  2848   63    0 python3          │
│      55   1.2     0     0     0     0     0     0    0    0 kswapd0          │
│     849   1.2   430m 6568   356 67940     0  2452    0    0 motion           │

and system is crashing once a day approximately (but might be or not be related due to usb overload)
/var/log/messages is flooded with:

ep  5 05:19:32 lysmarine tracker-store[3128]: Could not ensure resource existence: database is locked (strerror of errno (not ne
cessarily related): Resource temporarily unavailable)
Sep  5 05:19:32 lysmarine tracker-store[3128]: Could not ensure graph existence: database is locked (strerror of errno (not neces
sarily related): Resource temporarily unavailable)
Sep  5 05:19:32 lysmarine tracker-store[3128]: Could not ensure resource existence: database is locked (strerror of errno (not ne
cessarily related): Resource temporarily unavailable)
Sep  5 05:19:32 lysmarine tracker-store[3128]: Could not ensure resource existence: database is locked (strerror of errno (not ne
cessarily related): Resource temporarily unavailable)
Sep  5 05:19:32 lysmarine tracker-store[3128]: Could not ensure resource existence: database is locked (strerror of errno (not ne
cessarily related): Resource temporarily unavailable)
Sep  5 05:19:32 lysmarine tracker-store[3128]: Could not delete FTS text: database is locked (strerror of errno (not necessarily 
related): Resource temporarily unavailable)
...

Sep  5 05:19:33 lysmarine tracker-extract[4364]: Could not insert metadata for item "file:///home/user/Music/Velvet%20Dreamer%20-%20Collection/2015%20-%20Eternal%20Beauty/15.%20Forgotten%20Places.mp3": database is locked (strerror of errno (not necessarily related): Resource temporarily unavailable)
Sep  5 05:19:33 lysmarine tracker-extract[4364]: If the error above is recurrent for the same item/ID, consider running "tracker-extract" in the terminal with the TRACKER_VERBOSITY=3 environment variable, and filing a bug with the additional information
Sep  5 05:19:33 lysmarine tracker-extract[4364]: Could not insert metadata for item "file:///home/user/Music/Velvet%20Dreamer%20-%20Collection/2015%20-%20Eternal%20Beauty/10.%20Midnight%20Lilies.mp3": database is locked (strerror of errno (not necessarily related): Resource temporarily unavailable)

Sep  5 05:20:38 lysmarine tracker-store[3128]: Could not delete FTS text: database is locked
Sep  5 05:20:38 lysmarine tracker-store[3128]: Could not ensure resource existence: database is locked
Sep  5 05:20:38 lysmarine tracker-store[3128]: Could not ensure graph existence: database is locked
Sep  5 05:20:38 lysmarine tracker-store[3128]: Could not ensure resource existence: database is locked
Sep  5 05:20:38 lysmarine tracker-store[3128]: Could not ensure resource existence: database is locked
Sep  5 05:20:38 lysmarine tracker-store[3128]: Could not ensure resource existence: database is locked

the above messages relate only to /home/user/Music sub directories though
any idea what is the cause?
I found this workaround https://unix.stackexchange.com/questions/482390/usr-lib-tracker-tracker-store-causes-very-heavy-cpu-load-on-debian-buster and it stopped polluting /var/log/messages for now.

Anyone experienced this?

[mgrouch]

BBN OS doesn't install tracker or tracker-store. Is that something you installed on your own and what for?

[atchik6056]

I just did multiple upgrades with standard apt upgrade update and sudo apt full-upgrade, also installed additional software but not specifically tracker. It might be included as prereq or so into some additional packages I have installed. I will find out which one is using tracker
thank you for the answer, Michael

[atchik6056]

FYI
apparently tracker was installed by either of gnome-sushi nautilus nautilus-nextcloud,
well files or nautilus is default file manager for gnome
found this https://www.linuxuprising.com/2019/07/how-to-completely-disable-tracker.html:

user@lysmarine:~ $ sudo apt remove tracker tracker-extract tracker-miner-fs
Reading package lists... Done
Building dependency tree... Done
Reading state information... Done
The following packages were automatically installed and are no longer required:
  gir1.2-evince-3.0 gir1.2-javascriptcoregtk-4.0 gir1.2-nautilus-3.0
  gir1.2-webkit2-4.0 gstreamer1.0-gtk3 libexiv2-27 libgexiv2-2
  libgnome-autoar-0-0 libgsf-1-114 libgsf-1-common libiptcdata0
  libmusicbrainz5-2 libosinfo-1.0-0 libquvi-0.9-0.9.3 libquvi-scripts-0.9
  libtotem-plparser-common libtotem-plparser18 libtracker-control-2.0-0
  libtracker-miner-2.0-0 libtracker-sparql-2.0-0 lua-bitop lua-expat lua-json
  lua-lpeg lua-socket nautilus-data osinfo-db python3-nautilus
Use 'sudo apt autoremove' to remove them.
The following packages will be REMOVED:
  gnome-sushi nautilus nautilus-nextcloud tracker tracker-extract
  tracker-miner-fs
0 upgraded, 0 newly installed, 6 to remove and 113 not upgraded.
After this operation, 8,693 kB disk space will be freed.
Do you want to continue? [Y/n] n
Abort.

so I disabled it in settings->search (was enabled) and it seems turned off or be idling:

user@lysmarine:~ $ tracker status
Currently indexed: 0 files, 0 folders
Remaining space on database partition: 16.9 GB (6.73%)
All data miners are idle, indexing complete

keep an eye on it
thank you