Rapid Photo Downloader

sqlite3.OperationalError when generating thumbnails

Bug #1872188 reported by Tobias Ek
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Rapid Photo Downloader
Fix Released
High
Damon Lynch
Rapid Photo Downloader 0.9.23

Bug Description

Version 09.20
Arch Linux build
I have seen the same behavior before on earlier versions as well, at least a year, maybe more.
I normally read directly from the SD-card / CF-card using the same card reader.
Cameras: Nikon D300, Nikon D700, Nikon D7100, Nikon D5200

Steps to reproduce:
* Start the application with a new batch of photos in a directory on the SD-card.
* When reading a directory (directly after startup), the background (I assume it is a separate thread) creating the thumbnails hangs. The progress bar stops and no more thumbnails are created. The rest of the application is working fine.
* Restarting the application resumes the creation of thumbnails from the position it hanged.

Observations:
I experience that this happens much more often when importing from D7100 (24MPixel SD RAW 25-30MB) with much larger files than with the D300/D700 (12MPixel CF RAW 12-15MB), and after around 100-150 images or something similar.

Related branches

lp:rapid
Revision history for this message
Damon Lynch (dlynch3) wrote :

Include in your bug report the log files, which are found in the log directory ~/.cache/rapid-photo-downloader/log. Include all the log files, including the compressed ones. You can open the log file directory by clicking on the link in the "Report a Problem" dialog window. If possible, please also include the configuration file found in the directory ~/.config/Rapid Photo Downloader/.

Changed in rapid:
status: New → Incomplete
Revision history for this message
Tobias Ek (tobiaseken) wrote :
Revision history for this message
Tobias Ek (tobiaseken) wrote :
Revision history for this message
Tobias Ek (tobiaseken) wrote :
Revision history for this message
Tobias Ek (tobiaseken) wrote :
Revision history for this message
Tobias Ek (tobiaseken) wrote :
Revision history for this message
Tobias Ek (tobiaseken) wrote :
Revision history for this message
Tobias Ek (tobiaseken) wrote :
Revision history for this message
Tobias Ek (tobiaseken) wrote :
Revision history for this message
Tobias Ek (tobiaseken) wrote :
Revision history for this message
Tobias Ek (tobiaseken) wrote :
Revision history for this message
Tobias Ek (tobiaseken) wrote :

I guess all 10 compressed are not needed, but they are quite small so it's a low cost to provide as much info as possible.

Revision history for this message
Damon Lynch (dlynch3) wrote :

Thanks for all the log files. They are useful for me, thanks. Next time you can just add them to one archive (zip or tar etc.) and attach that to a bug report.

summary: - Creating thumbnails thread freezes
+ sqlite3.OperationalError when generating thumbnails
Changed in rapid:
status: Incomplete → Triaged
Revision history for this message
Damon Lynch (dlynch3) wrote :

Out of curiosity are you running on an HDD or an SSD? It looks very much like your system is struggling to keep up with the throughput, which is causing sqlite3 to not release its lock in a timely manner.

Revision history for this message
Tobias Ek (tobiaseken) wrote : Re: [Bug 1872188] Re: sqlite3.OperationalError when generating thumbnails

Hi

It struck my mind after 3 files...

On 2020-04-11 23:22, Damon Lynch wrote:
> Thanks for all the log files. They are useful for me, thanks. Next time
> you can just add them to one archive (zip or tar etc.) and attach that
> to a bug report.
>
> ** Summary changed:
>
> - Creating thumbnails thread freezes
> + sqlite3.OperationalError when generating thumbnails
>
> ** Changed in: rapid
> Status: Incomplete => Triaged
>

Revision history for this message
Tobias Ek (tobiaseken) wrote :

Hi

I have both SSD and HDD in this machine.

I have the system on an SSD, but my user home directory and the target
for the files on an HDD, so I guess everything Rapid is writing will be
to the HDD.

//Tobias

On 2020-04-11 23:23, Damon Lynch wrote:
> Out of curiosity are you running on an HDD or an SSD? It looks very much
> like your system is struggling to keep up with the throughput, which is
> causing sqlite3 to not release its lock in a timely manner.
>

Revision history for this message
Damon Lynch (dlynch3) wrote :

The next release contains a fix for this bug. It's difficult for me to test because I cannot replicate it on my system, but nonetheless the fix should work.

If it does not, please reopen the bug. Don't wait a year to do so!

Changed in rapid:
status: Triaged → Fix Committed
importance: Undecided → High
assignee: nobody → Damon Lynch (dlynch3)
milestone: none → 0.9.23
Damon Lynch (dlynch3)
Changed in rapid:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.