Missing file

[macminoz]

hi, during the massive importing data, I notice several log like this:

INFO | server has same asset | file=1946/11/VID_20121102_090926.mp4 info="the server has this file" time="2024-11-07T12:11.21 CET"
INFO | server has same asset | file=1946/11/VID_20121104_101048.mp4 info="the server has this file" time="2024-11-07T12:11.22 CET"

but if I start looking at the upload folder, this file is missing. What can I do ? Of course this mp4 isn't available under the gallery and so the research:

me@NAS:/volume1/IMMICH-MASTER-CATALOG_20Ott24/$ find . | grep -i VID_20121102_090926.mp4
me@NAS:/volume1/IMMICH-MASTER-CATALOG_20Ott24/$

I have the feeling that the immich-go consider this file similar to another with the same creation time :

me@beorn ~ % ffmpeg -i VID_20121102_090926.mp4 -dump | grep -i creation_time
creation_time : 2012-11-02T08:09:43.000000Z

Where this file is located ?

[simulot]

Immich renames files with an id before storing them. The find . is helpless.
You can use the immich's image search to locate the file on immich. On details, you get the actual path:

Immich-go gets the list of uploaded files with their name, date and length before processing the input.
File with same attributes are discarded from the import with that message. If you have duplicates in your data set, you'll get the same message as well for the 2nd occurrence of the file.

[redge76]

If you use Storage template you should be able to keep the image filename.
https://immich.app/docs/administration/storage-template/

[macminoz]

Immich renames files with an id before storing them. The find . is helpless. You can use the immich's image search to locate the file on immich. On details, you get the actual path:

Immich-go gets the list of uploaded files with their name, date and length before processing the input. File with same attributes are discarded from the import with that message. If you have duplicates in your data set, you'll get the same message as well for the 2nd occurrence of the file.

I'm not able to find even with the Image Search. I looked it via Name or with Creation Date but I cannot find it. What I have to do? thanks

[macminoz]

If you use Storage template you should be able to keep the image filename. https://immich.app/docs/administration/storage-template/

nope, same story :(

[simulot]

Have you checked the log files?

[macminoz]

where ? I only noticed logs from immich-go importer (on the first post)

[simulot]

It's not possible to have a good understanding with this small context.

This message can be also returned by the server when it has already got the same binary, whatever is name.
The file could be also in the immich's trash can.

[macminoz]

checked also there...it's a mystery.
What I'm trying to do is avoid any data loss because of "the server has this file" message before deleting from a sparse archive. I'm trying the immich-cli right now but it's very slow (especially for 250K pictures and 9K videos). Keep you posted! Thanks

[simulot]

As far as I know immich-cli pushes all files to the server and let it deciding if it's a duplicate or not. So, it's more precise, but way slower.