MakeFile and Upload takes too much time, because of locks and serialization issues

I have a pretty fast connection myself and while my experience hasn't been this bad, it has taken ~48 hours to transfer 13 Gig of 10k files.

By the way. This is from a single client with no web interaction and no other clients active. So theoretically, there should be no locking issues.

File removal is really slow too.

Removal of a complete source tree for madwifi (623 files) took 15 minutes yesterday. It was really strange to see that applet says 'Your files are up to date' but the files in the testing directory did not want to go to the server until I get to the logs.

8 files were removed from server in 16 seconds. So one file roughly takes 2 seconds.
2009-12-05 20:51:27,318 - ubuntuone.SyncDaemon.State - DEBUG - IDLE --[SYS_META_QUEUE_WAITING]--> START_WORKING_ON_METADATA
...
2009-12-05 20:51:43,083 - ubuntuone.SyncDaemon.State - DEBUG - START_WORKING_ON_METADATA --[SYS_META_QUEUE_DONE]--> IDLE

This problem is making ubuntu one worthless, right now I am trying to upload 55 small files and it's uploading at 1.32 kb/s....that's right....1.32 kb/s....I'm going to go back to my old backup method until this is all sorted out. Removing the config file in my home folder didn't solve anything at all

Bug #396650 is another duplicate (I just can't mark it as such, because there already duplicates attached to #396650).

I've been running a sync for about two hours, right now I see Updating 406 of 14265 files... I don't know the exact upload speed, but the total size of the directory tree is 2.2Gb, meaning that the average file should be about 159 K, and upload is proceeding at about 1K/s.

I do not have an idea what causes this.

I do not have an idea what causes this.

Bump!

This bug description makes assumptions about what causes a slow upload. I think we have proven this is not related to database locks but is related to other issues. Should we update this bug description? Do we know where the bottlenecks are?

My feeling is that when I start uploading to Ubuntu One, it's spamming my
router and DSL modem... I don't know what kind of packets it's spamming it
with, but latency pinging to the first gateway past my DSL modem from any
computers on my LAN shoots to around 1000 ms when the upload is in progress.
I'll be happy to look at this with a protocol analyzer when I get home.

On Tue, May 11, 2010 at 11:38 AM, John O'Brien <email address hidden> wrote:

> Bump!
>
> This bug description makes assumptions about what causes a slow upload.
> I think we have proven this is not related to database locks but is
> related to other issues. Should we update this bug description? Do we
> know where the bottlenecks are?
>
> --
> MakeFile and Upload takes too much time, because of locks and serialization
> issues
> https://bugs.launchpad.net/bugs/485004
> You received this bug notification because you are a direct subscriber
> of the bug.
>
> Status in Ubuntu One Servers: Triaged
>
> Bug description:
> Making tens or hundreds of makefiles and uploads tend to take too much
> time... not because the content upload, but from the database interaction,
> serialization issues, locks, etc.
>
> To unsubscribe from this bug, go to:
> https://bugs.launchpad.net/ubuntuone-servers/+bug/485004/+subscribe
>

--
Only one carry on? No electronics for the first hour of flight? I wish that,
just once, some terrorist would try something that you can only foil by
upgrading the passengers to first glass and giving them free drinks. --
Bruce Schnier
"Unix is user-friendly. It just isn't promiscuous about which users it's
friendly with." – Steven King

Sorry I can't contribute much to the troubleshooting here, but I can confirm that Ubuntu One is painfully slow, especially compared to Dropbox. I found that to be a barrier to use. One thing to keep in mind while investigating this is Dropbox's "LAN sync" functionality. That might be partially responsible for the faster transfer speeds reported with Dropbox, although it seems to me that Ubuntu One is far slower on remote transfers as well.

This already was attacked and solved. Transaction times are not the best now that can achieve, but now it's a matter of tuning, so I consider this point closed.

Frustrated? See comments 12 and 13 here
http://ubuntuforums.org/showthread.php?p=9916004

I'm sorry, but this simply isn't fixed. Maybe your lock and serialization issues are fixed, but over here I'm still taking upwards of 10-15 minutes to upload a few text files to UbuntuOne. It's broken.

@lafleche.jonathan : You are probably hit by bug 436612.

i have a current 11.04 installation and try to use ubuntuOne (1.6.2) - VERY slow.
after 2 days - 130 mb are stored.
it seems not that the performance issues are solved.

I have a current 11.04 installation as well and am trying to sync some of my bought music from other stores with Ubuntu One. These are currently ~4.5 GB of MP3's which I want to sync.

I'm on a 10 GBit connection and uploads are between 0kb (yes, zero) and 100kb.

The sync daemon starts 13 processes, there's a lot of hard disc usage and the load goes up to 9, then drops to 0-2 and at some point goes up again ......

I sometimes get notification windows telling me all the time that there is "File XYZ and 180 other files being uploaded", however, XYZ doesn't change at all. (Its actually an MP3 thats about 200 MB)

Since the machine becomes sometimes unusable with this high load, this problem is highly disturbing. (I'm running a Dual Core Intel Centrino with 2 GB of RAM, so it should really work)

If you need any more information, please tell me!

Please open a new bug for your issue as this bug is closed. Thanks in advance.

got fresh updates for Ubuntu 11.10 - still big problem - and not even slow loading - i can`t upload at all pdf ( about 20Mb) with LinuxFormat to U1

@Vyacheslav: you might want to take a look at Bug #872924 (better fits your description of the problem) as this bug here is fixed and closed.