Mailing List Archive: Slow Apt

Slow Apt

Jun 10, 2021, 3:49 PM

Post #1 of 5 (503 views)

First, hello. New to the list, but I've been using Xen Hypervisor for a
long time.

I'm curious if anyone else has had this issue.

I recently upgraded a server from Debian Squeeze to Buster with kernel
4.19.0-16-amd64 and found that apt/aptitude commands are slow in response.

For example, 'apt-get update' can take 10 minutes to complete, hanging
up on certain parts of the downloads either at 0% or 90%. This is
something that normally takes a few seconds.

Even the DomU's suffer the same issue.

On another server I have kernel 4.19.0-14-amd64 and it seems to be
running just fine most of the time. I do get some hiccups, but not
nearly as much as the above upgraded server.

I've also noticed that writes will sometimes pause for several seconds,
specially when transferring large files.

Setup:

E3-1230 V2 @ 3.30GHz

16 GB RAM

Hard drives are spinning disk. 2 TB drives (EXT4)

DomUs are using Disk.Img for their disk.

Re: Slow Apt [ In reply to ]

chrismyers81 at gmail

Jun 10, 2021, 5:29 PM

Post #2 of 5 (503 views)

Permalink

Out of curiosity, how does "top" look when it's running? Especially things
like "wa" (IOWait) and "st" (steal)?

On Thu, Jun 10, 2021 at 5:49 PM TheBearAK <thebearak@gmail.com> wrote:

> First, hello. New to the list, but I've been using Xen Hypervisor for a
> long time.
>
> I'm curious if anyone else has had this issue.
>
> I recently upgraded a server from Debian Squeeze to Buster with kernel
> 4.19.0-16-amd64 and found that apt/aptitude commands are slow in response.
>
> For example, 'apt-get update' can take 10 minutes to complete, hanging
> up on certain parts of the downloads either at 0% or 90%. This is
> something that normally takes a few seconds.
>
> Even the DomU's suffer the same issue.
>
>
> On another server I have kernel 4.19.0-14-amd64 and it seems to be
> running just fine most of the time. I do get some hiccups, but not
> nearly as much as the above upgraded server.
>
>
> I've also noticed that writes will sometimes pause for several seconds,
> specially when transferring large files.
>
>
> Setup:
>
> E3-1230 V2 @ 3.30GHz
>
> 16 GB RAM
>
> Hard drives are spinning disk. 2 TB drives (EXT4)
>
> DomUs are using Disk.Img for their disk.
>
>
>

--
People use duct tape to fix everything....God used nails.

http://www.myerscountry.net

Re: Slow Apt [ In reply to ]

thebearak at gmail

Jun 10, 2021, 9:31 PM

Post #3 of 5 (503 views)

Permalink

Hovers around 10.5 wa and 0.2 to 0.3 in st.

Top processes are vifs with a loop4 popping up to the top once in a
while along with rcu_sched.

I would guess the loop4 is the mounted disk image for the DomU.

So, after the 'apt-get update' finished, the wa dropped to 0.4 and st
stayed at 0.2

On 6/10/21 4:29 PM, Chris Myers wrote:
> Out of curiosity, how does "top" look when it's running? Especially
> things like "wa" (IOWait) and "st" (steal)?
>
> On Thu, Jun 10, 2021 at 5:49 PM TheBearAK <thebearak@gmail.com
> <mailto:thebearak@gmail.com>> wrote:
>
> First, hello. New to the list, but I've been using Xen Hypervisor
> for a
> long time.
>
> I'm curious if anyone else has had this issue.
>
> I recently upgraded a server from Debian Squeeze to Buster with
> kernel
> 4.19.0-16-amd64 and found that apt/aptitude commands are slow in
> response.
>
> For example, 'apt-get update' can take 10 minutes to complete,
> hanging
> up on certain parts of the downloads either at 0% or 90%. This is
> something that normally takes a few seconds.
>
> Even the DomU's suffer the same issue.
>
>
> On another server I have kernel 4.19.0-14-amd64 and it seems to be
> running just fine most of the time. I do get some hiccups, but not
> nearly as much as the above upgraded server.
>
>
> I've also noticed that writes will sometimes pause for several
> seconds,
> specially when transferring large files.
>
>
> Setup:
>
> E3-1230 V2 @ 3.30GHz
>
> 16 GB RAM
>
> Hard drives are spinning disk. 2 TB drives (EXT4)
>
> DomUs are using Disk.Img for their disk.
>
>
>
>
> --
> People use duct tape to fix everything....God used nails.
>
> http://www.myerscountry.net <http://www.myerscountry.net>

Re: Slow Apt [ In reply to ]

chrismyers81 at gmail

Jun 14, 2021, 2:44 PM

Post #4 of 5 (501 views)

Permalink

Interesting...a wait of 10% isn't great but isn't horrible either, I
wouldn't see that as a cause of delays like that. (I recently had issues
with a "new" board that had a lot of "steal" even when basically doing
nothing, so I was curious if you were running into that too.)

Other than "apt" commands, how do other network-based tasks look?

I upgraded from Stretch to Buster a year or so ago and haven't run into
this so far.

Other than apt commands, how does everything look?

On Thu, Jun 10, 2021 at 11:32 PM TheBearAK <thebearak@gmail.com> wrote:

> Hovers around 10.5 wa and 0.2 to 0.3 in st.
>
> Top processes are vifs with a loop4 popping up to the top once in a while
> along with rcu_sched.
>
> I would guess the loop4 is the mounted disk image for the DomU.
> So, after the 'apt-get update' finished, the wa dropped to 0.4 and st
> stayed at 0.2
>
>
> On 6/10/21 4:29 PM, Chris Myers wrote:
>
> Out of curiosity, how does "top" look when it's running? Especially things
> like "wa" (IOWait) and "st" (steal)?
>
> On Thu, Jun 10, 2021 at 5:49 PM TheBearAK <thebearak@gmail.com> wrote:
>
>> First, hello. New to the list, but I've been using Xen Hypervisor for a
>> long time.
>>
>> I'm curious if anyone else has had this issue.
>>
>> I recently upgraded a server from Debian Squeeze to Buster with kernel
>> 4.19.0-16-amd64 and found that apt/aptitude commands are slow in response.
>>
>> For example, 'apt-get update' can take 10 minutes to complete, hanging
>> up on certain parts of the downloads either at 0% or 90%. This is
>> something that normally takes a few seconds.
>>
>> Even the DomU's suffer the same issue.
>>
>>
>> On another server I have kernel 4.19.0-14-amd64 and it seems to be
>> running just fine most of the time. I do get some hiccups, but not
>> nearly as much as the above upgraded server.
>>
>>
>> I've also noticed that writes will sometimes pause for several seconds,
>> specially when transferring large files.
>>
>>
>> Setup:
>>
>> E3-1230 V2 @ 3.30GHz
>>
>> 16 GB RAM
>>
>> Hard drives are spinning disk. 2 TB drives (EXT4)
>>
>> DomUs are using Disk.Img for their disk.
>>
>>
>>
>
> --
> People use duct tape to fix everything....God used nails.
>
> http://www.myerscountry.net
>
>

--
People use duct tape to fix everything....God used nails.

http://www.myerscountry.net

Re: Slow Apt [ In reply to ]

thebearak at gmail

Jun 14, 2021, 3:52 PM

Post #5 of 5 (501 views)

Permalink

Other networking is mostly perfect.   Once in a while I'll get a spot
where it is uploading or downloading and it pauses for a sec or two.
Other than apt, everything seems to run normal speed.

I do have one DomU that runs fast except when it serves web pages, but I
think that is a different issue. The web pages are being built from a
database and I think the database performance is slow.   Its working, so
I put that on the back-burner for now.

Only 3 DomU's running on this server and they are <1% busy at any given
time.

I've seen this happen at least 3 other times with Buster and Apt on Xen.

On 6/14/21 1:44 PM, Chris Myers wrote:
> Interesting...a wait of 10% isn't great but isn't horrible either, I
> wouldn't see that as a cause of delays like that. (I recently had
> issues with a "new" board that had a lot of "steal" even when
> basically doing nothing, so I was curious if you were running into
> that too.)
>
> Other than "apt" commands, how do other network-based tasks look?
>
> I upgraded from Stretch to Buster a year or so ago and haven't run
> into this so far.
>
> Other than apt commands, how does everything look?
>
>
>
> On Thu, Jun 10, 2021 at 11:32 PM TheBearAK <thebearak@gmail.com
> <mailto:thebearak@gmail.com>> wrote:
>
> Hovers around 10.5 wa and 0.2 to 0.3 in st.
>
> Top processes are vifs with a loop4 popping up to the top once in
> a while along with rcu_sched.
>
> I would guess the loop4 is the mounted disk image for the DomU.
>
> So, after the 'apt-get update' finished, the wa dropped to 0.4 and
> st stayed at 0.2
>
>
> On 6/10/21 4:29 PM, Chris Myers wrote:
>> Out of curiosity, how does "top" look when it's running?
>> Especially things like "wa" (IOWait) and "st" (steal)?
>>
>> On Thu, Jun 10, 2021 at 5:49 PM TheBearAK <thebearak@gmail.com
>> <mailto:thebearak@gmail.com>> wrote:
>>
>> First, hello. New to the list, but I've been using Xen
>> Hypervisor for a
>> long time.
>>
>> I'm curious if anyone else has had this issue.
>>
>> I recently upgraded a server from Debian Squeeze to Buster
>> with kernel
>> 4.19.0-16-amd64 and found that apt/aptitude commands are slow
>> in response.
>>
>> For example, 'apt-get update' can take 10 minutes to
>> complete, hanging
>> up on certain parts of the downloads either at 0% or 90%.
>> This is
>> something that normally takes a few seconds.
>>
>> Even the DomU's suffer the same issue.
>>
>>
>> On another server I have kernel 4.19.0-14-amd64 and it seems
>> to be
>> running just fine most of the time. I do get some hiccups,
>> but not
>> nearly as much as the above upgraded server.
>>
>>
>> I've also noticed that writes will sometimes pause for
>> several seconds,
>> specially when transferring large files.
>>
>>
>> Setup:
>>
>> E3-1230 V2 @ 3.30GHz
>>
>> 16 GB RAM
>>
>> Hard drives are spinning disk. 2 TB drives (EXT4)
>>
>> DomUs are using Disk.Img for their disk.
>>
>>
>>
>>
>> --
>> People use duct tape to fix everything....God used nails.
>>
>> http://www.myerscountry.net <http://www.myerscountry.net>
>
>
>
> --
> People use duct tape to fix everything....God used nails.
>
> http://www.myerscountry.net <http://www.myerscountry.net>