Upload function not uploading all inputs

[alsonh]

I'm running into an issue with processing a group of three Google Takeout .zip files and not uploading all the files. I've run the same command multiple times, and each time it seems to upload an additional small chunk of files, but always gets to about 51% and then abruptly stops but looks like it has been completed successfully. Anyone run into this issue before?

The command that I'm running is: immich-go.exe -server [server] -key [key] upload -google-photos -create-albums takeout-*.zip

Some extracts of the log from the three most recent runs

Run 1
Input analysis:

scanned image file : 33123
scanned video file : 6368
scanned sidecar file : 36554
discarded file : 6
unsupported file : 11
file duplicated in the input : 17007
associated metadata file : 39484
missing associated metadata file : 0

Uploading:

uploaded : 3288
upload error : 0
file not selected : 0
server's asset upgraded with the input : 7
server has same asset : 15873
server has a better asset : 1683
| time="2024-07-06T06:32.09 AEST"

Run 2
Input analysis:

scanned image file : 33123
scanned video file : 6368
scanned sidecar file : 36554
discarded file : 6
unsupported file : 11
file duplicated in the input : 17000
associated metadata file : 39484
missing associated metadata file : 0

Uploading:

uploaded : 205
upload error : 0
file not selected : 0
server's asset upgraded with the input : 0
server has same asset : 18562
server has a better asset : 1683
| time="2024-07-06T06:39.38 AEST"

Run 3
Input analysis:

scanned image file : 33123
scanned video file : 6368
scanned sidecar file : 36554
discarded file : 6
unsupported file : 11
file duplicated in the input : 17002
associated metadata file : 39484
missing associated metadata file : 0

Uploading:

uploaded : 202
upload error : 0
file not selected : 0
server's asset upgraded with the input : 0
server has same asset : 18563
server has a better asset : 1683
| time="2024-07-06T10:38.48 AEST"

[simulot]

I suggest to look at the log files for having the error cause.

[simulot]

I have fixed an issue in the latest version. Duplicated files weren't detected and counted correctly.

[alsonh]

I've just downloaded v0.19.1. It got up to 51% uploading just before it stopped. Will try to make some time tomorrow to have a closer look

[simulot]

Try to enable the -api-trace option, the last lines of this big file will which task is hanging

[alsonh]

Uploading immich-go_2024-07-09_22-46-37.trace.log…
I had a quick scan through the end and wasn't able to find anything that stood out to me. I'll have a read of the code tomorrow to understand how it works and let you know if I find anything.

[simulot]

Unfortunately there is no file attached. You can join my using discord @simulot