$ tracker3 status
Currently indexed: 131644 files, 11385 folders
Remaining space on database partition: 18,0 GB (41,12%)
All data miners are idle, indexing complete
599 recorded failures
Is it expected to get “recorded failures” at Tracker 3? Or must I open issues until I reach zero “recorded failures”?
Obs: A lot of these “recorded failures” happen with image files.
Obs2: Gnome offers to index “Home” … Is it a good idea? Or a lot of cache and configuration files will be indexed?
tracker3 status [pattern] to match failed files, and print more detailed status than a single line
tracker3 extract [file] to trigger metadata extraction from the command line, Add G_MESSAGES_DEBUG=Tracker and TRACKER_DEBUG=all for more verbose output.
Forgot to reply here. $HOME is indexed non-recursively by default, and hidden folders/files are skipped. There’s no risk of it going through all of your files, nor config/caches.
This is for good measure, imagine Tracker Miners monitoring its own database :).
There will be a single copy of the indexed data. Tracker-miner-fs should also manage nested indexed folders properly.
Yup, those settings allow */? tokens, as per GPatternSpec. Although you probably want ignored-directories, ignored-directories-with-content will ignore the parent directory of the matching file altogether. I assume you just want to skip *_files, not e.g. the downloads directory .
Filing a Tracker Miners bug for those GIF files is nonetheless still appreciated. These files shouldn’t fail, unless corrupted.
There are just a bunch of errors in my Tracker log now … The majority are with ISOs of Sony consoles.
About an error in a seemly OK PDF file:
$ tracker3 status pdf
URI: file:///var/mnt/home/home/dread/Documents/estudos/Hist%C3%B3ria%20-%20Mestrado%20-%20UFSC%20(2018-2019)/2018.2%20-%202%20semestre/disciplinas/HST%203333003%20-%20Est%C3%A1gio%20Doc%C3%AAncia/HST%207602%20->
Message: SparqlTimeSort helper: Failed time string conversion (strerror of errno (not necessarily related): No such file or directory)
SPARQL: INSERT DATA { GRAPH tracker:FileSystem { <file:///var/mnt/home/home/dread/Documents/estudos/Hist%C3%B3ria%20-%20Mestrado%20-%20UFSC%20(2018-2019)/2018.2%20-%202%20semestre/disciplinas/HST%203333003%>
GRAPH <http://tracker.api.gnome.org/ontology/v3/tracker#Documents> {
<urn:contact:Francisco%20Carlos%20Teixeira%20da%20Silva> nco:fullname ?nco_fullname } };
DELETE WHERE {
GRAPH <http://tracker.api.gnome.org/ontology/v3/tracker#Documents> {
<urn:contact:Francisco%20Carlos%20Teixeira%20da%20Silva> rdf:type ?rdf_type } };
INSERT DATA {
GRAPH <http://tracker.api.gnome.org/ontology/v3/tracker#Documents> {
<urn:contact:Francisco%20Carlos%20Teixeira%20da%20Silva> a nco:Contact ;
nco:fullname "Francisco Carlos Teixeira da Silva" .
<file:///var/mnt/home/home/dread/Documents/estudos/Hist%C3%B3ria%20-%20Mestrado%20-%20UFSC%20(2018-2019)/2018.2%20-%202%20semestre/disciplinas/HST%203333003%20-%20Est%C3%A1gio%20Doc%C3%AAncia/HST%207602%20-%20H>
_:608065 a nfo:PaginatedTextDocument , nfo:PaginatedTextDocument ;
nco:creator <urn:contact:Francisco%20Carlos%20Teixeira%20da%20Silva> ;
nie:description "" ;
nie:mimeType "application/pdf" ;
nie:isStoredAs <file:///var/mnt/home/home/dread/Documents/estudos/Hist%C3%B3ria%20-%20Mestrado%20-%20UFSC%20(2018-2019)/2018.2%20-%202%20semestre/disciplinas/HST%203333003%20-%20Est%C3%A1gio%20Doc%C3%AAncia/H>
nfo:pageCount 41 ;
nie:plainTextContent "" ;
nie:title "Crise da ditadura militar e o processo de abertura política no Brasil, 1974-1985" ;
nie:contentCreated "0100-12-31T21:00:00-03:00" .
}
};
An of the errors with ISOs:
[Report]
Uri=file:///var/mnt/home/home/dread/Documents/games/consoles/Sony%20-%20PSP/roms/Tactics%20Ogre:%20Let%20Us%20Cling%20Together/Tactics%20Ogre%20patched.iso
Message=Could not get any metadata for uri:'file:///var/mnt/home/home/dread/Documents/games/consoles/Sony%20-%20PSP/roms/Tactics%20Ogre:%20Let%20Us%20Cling%20Together/Tactics%20Ogre%20patched.iso' and mime:'application/x-cd-image'
tracker3 extract Tactics\ Ogre*
file:///var/mnt/home/home/dread/Documents/games/consoles/Sony%20-%20PSP/roms/Tactics%20Ogre:%20Let%20Us%20Cling%20Together/Tactics%20Ogre.iso: No metadata or extractor modules found to handle this file
file:///var/mnt/home/home/dread/Documents/games/consoles/Sony%20-%20PSP/roms/Tactics%20Ogre:%20Let%20Us%20Cling%20Together/Tactics%20Ogre%20patched.iso: No metadata or extractor modules found to handle this file
In my tests (with AND operator) … tracker2 search finds a lot of PDFs and tracker3 search didn’t find this content inside pdfs.
Ah, the number of indexed files is different too!
$ tracker status
Currently indexed: 106524 files, 9570 folders
Remaining space on database partition: 17,3 GB (39,62%)
All data miners are idle, indexing complete
$ tracker3 status
Currently indexed: 96954 files, 9570 folders
Remaining space on database partition: 17,3 GB (39,62%)
All data miners are idle, indexing complete
8 recorded failures
Tracker 3 is more conservative about indexing text/plain files because this reduces the risk of indexing huge sets of log files, data files, source code etc. and the corresponding high resource consumption that can cause.
There is a new config key which specifies allowed text/plain content:
$ gsettings get org.freedesktop.Tracker3.Extract text-allowlist
['*.txt', '*.md', '*.mdwn']
I’m open to extending the default here within reason, if there are more plain text formats that are usually worth indexing.
OK, I notice you posted already about an error with PDFs. The log shows that the extractor is generating invalid SPARQL, specifically here:
<file:///var/mnt/home/home/dread/Documents/estudos/Hist%C3%B3ria%20-%20Mestrado%20-%20UFSC%20(2018-2019)/2018.2%20-%202%20semestre/disciplinas/HST%203333003%20-%20Est%C3%A1gio%20Doc%C3%AAncia/HST%207602%20-%20H>
_:608065 a nfo:PaginatedTextDocument , nfo:PaginatedTextDocument ;
Could you open an issue about this? It would be amazing if you could also attach one of the PDFs that trigger this issue so we can add it to the testsuite, but if that’s not possible or practical then don’t worry.
I expect this is the reason that you’re seeing fewer results from PDFs than before.
the PDFs that are missing from results aren’t appointed as problematic by tracker3 status .
That may because the errors are missing. Or because there’s another issue at work. Try running tracker3 info on a file that doesn’t have any errors reported. Do you see the expected nie:plainTextContent output listed there? If not, the problem is that we can’t get the text. If yes, the problem is somewhere else.
.