Mailing List Archive

compile times for mythtv?
With my old system, building from source would take 10-15 minutes.

However, with my new system it takes only 40 seconds.

The hardware is Ryzen 5 3600, B550 motherboard with attached M.2 2280 NVMe
SSD.

I ran it once with make -j 6 and it ran in 5 minutes. Then I completely
deleted the build/mythtv directories and recloned mythtv.git again.
However, this time I used make -j 12.
That seems too good to be true.

Jim A
Re: compile times for mythtv? [ In reply to ]
On 16/11/2020 16:58, James Abernathy wrote:
> With my old system, building from source would take 10-15 minutes.
>
> However, with my new system it takes only 40 seconds.
>
> The hardware is Ryzen 5 3600, B550 motherboard with attached M.2 2280
> NVMe SSD.
>
> I ran it once with make -j 6 and it ran in 5 minutes.  Then I completely
> deleted the build/mythtv directories and recloned mythtv.git again.
> However, this time I used make -j 12.
> That seems too good to be true.
>
> Jim A
>
>

tl;dr -> ccache :)

long version -> if you installed the build dependencies with the ansible
playbooks, then you got ccache installed. you can check your hit ratio
with `ccache -s`


Regards
Stuart


_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org
Re: compile times for mythtv? [ In reply to ]
On Mon, Nov 16, 2020 at 10:00 AM James Abernathy <jfabernathy@gmail.com>
wrote:

> With my old system, building from source would take 10-15 minutes.
>
> However, with my new system it takes only 40 seconds.
>
> The hardware is Ryzen 5 3600, B550 motherboard with attached M.2 2280 NVMe
> SSD.
>
> I ran it once with make -j 6 and it ran in 5 minutes. Then I completely
> deleted the build/mythtv directories and recloned mythtv.git again.
> However, this time I used make -j 12.
> That seems too good to be true.
>
> Jim A
>

If you want a truly fresh environment to test with, also make sure you
delete your ~/.ccache directory between builds.

John
Re: compile times for mythtv? [ In reply to ]
On 16/11/2020 17:05, John P Poet wrote:
> On Mon, Nov 16, 2020 at 10:00 AM James Abernathy <jfabernathy@gmail.com
> <mailto:jfabernathy@gmail.com>> wrote:
>
> With my old system, building from source would take 10-15 minutes.
>
> However, with my new system it takes only 40 seconds.
>
> The hardware is Ryzen 5 3600, B550 motherboard with attached M.2
> 2280 NVMe SSD.
>
> I ran it once with make -j 6 and it ran in 5 minutes.  Then I
> completely deleted the build/mythtv directories and recloned
> mythtv.git again. However, this time I used make -j 12.
> That seems too good to be true.
>
> Jim A
>
>
> If you want a truly fresh environment to test with, also make sure you
> delete your ~/.ccache directory between builds.
>

That trashes your ccache config. Use `ccache -C`


Regards
Stuart

_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org
Re: compile times for mythtv? [ In reply to ]
On Mon, Nov 16, 2020 at 12:08 PM Stuart Auchterlonie <
stuarta@squashedfrog.net> wrote:

> On 16/11/2020 16:58, James Abernathy wrote:
> > With my old system, building from source would take 10-15 minutes.
> >
> > However, with my new system it takes only 40 seconds.
> >
> > The hardware is Ryzen 5 3600, B550 motherboard with attached M.2 2280
> > NVMe SSD.
> >
> > I ran it once with make -j 6 and it ran in 5 minutes. Then I completely
> > deleted the build/mythtv directories and recloned mythtv.git again.
> > However, this time I used make -j 12.
> > That seems too good to be true.
> >
> > Jim A
> >
> >
>
> tl;dr -> ccache :)
>
> long version -> if you installed the build dependencies with the ansible
> playbooks, then you got ccache installed. you can check your hit ratio
> with `ccache -s`
>
>
> Regards
> Stuart
>

Thanks, forgot about the ccache. I did use ansible to get my dependencies.

However with ccache deleted I used make -j 12 and did it in 4 min, 34sec.

That's a great improvement for me.

Jim A
Re: compile times for mythtv? [ In reply to ]
On Mon, Nov 16, 2020 at 12:08 PM Stuart Auchterlonie <
stuarta@squashedfrog.net> wrote:

> On 16/11/2020 16:58, James Abernathy wrote:
> > With my old system, building from source would take 10-15 minutes.
> >
> > However, with my new system it takes only 40 seconds.
> >
> > The hardware is Ryzen 5 3600, B550 motherboard with attached M.2 2280
> > NVMe SSD.
> >
> > I ran it once with make -j 6 and it ran in 5 minutes. Then I completely
> > deleted the build/mythtv directories and recloned mythtv.git again.
> > However, this time I used make -j 12.
> > That seems too good to be true.
> >
> > Jim A
> >
> >
>
> tl;dr -> ccache :)
>
> long version -> if you installed the build dependencies with the ansible
> playbooks, then you got ccache installed. you can check your hit ratio
> with `ccache -s`
>
>
> Regards
> Stuart
>

Thanks, forgot about the ccache. I did use ansible to get my dependencies.

However with ccache deleted I used make -j 12 and did it in 4 min, 34sec.

That's a great improvement for me.

Jim A
Re: compile times for mythtv? [ In reply to ]
On Mon, Nov 16, 2020 at 10:31 AM Stuart Auchterlonie <
stuarta@squashedfrog.net> wrote:

> On 16/11/2020 17:05, John P Poet wrote:
> > On Mon, Nov 16, 2020 at 10:00 AM James Abernathy <jfabernathy@gmail.com
> > <mailto:jfabernathy@gmail.com>> wrote:
> >
> > With my old system, building from source would take 10-15 minutes.
> >
> > However, with my new system it takes only 40 seconds.
> >
> > The hardware is Ryzen 5 3600, B550 motherboard with attached M.2
> > 2280 NVMe SSD.
> >
> > I ran it once with make -j 6 and it ran in 5 minutes. Then I
> > completely deleted the build/mythtv directories and recloned
> > mythtv.git again. However, this time I used make -j 12.
> > That seems too good to be true.
> >
> > Jim A
> >
> >
> > If you want a truly fresh environment to test with, also make sure you
> > delete your ~/.ccache directory between builds.
> >
>
> That trashes your ccache config. Use `ccache -C`
>

I was not aware there was a "ccache config". Thanks for the tip.

John
Re: compile times for mythtv? [ In reply to ]
On Mon, Nov 16, 2020 at 5:41 PM John P Poet <jppoet@gmail.com> wrote:

> I was not aware there was a "ccache config". Thanks for the tip.

While likely not used extensively by
"normal" people (of course few
"normal" people tend to participate
here), configuring your ccache cache
size is critical when you are building
a large number of different projects
to avoid constant cache churn.

While I am too lazy to look the details
up, the buildbot worker setup sets
the cache size to be something like
10G because those workers may be
building for master, fixes/31, fixes/30,
devel/xxxxx and you want to take
the most advantage of the cache.

And for those (such as myself)
that tend to build a lot of different
projects in mock, you often have
to change the cache size for your
mock instance(s) for the same
reason.

Of course, running on a m5dn.24xlarge
instance in AWS can mostly make
your build problems go away (to
potentially be replaced by the sticker
shock).
_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org
Re: compile times for mythtv? [ In reply to ]
On 16/11/2020 17:41, John P Poet wrote:
> On Mon, Nov 16, 2020 at 10:31 AM Stuart Auchterlonie
> <stuarta@squashedfrog.net <mailto:stuarta@squashedfrog.net>> wrote:
>
> On 16/11/2020 17:05, John P Poet wrote:
> > On Mon, Nov 16, 2020 at 10:00 AM James Abernathy
> <jfabernathy@gmail.com <mailto:jfabernathy@gmail.com>
> > <mailto:jfabernathy@gmail.com <mailto:jfabernathy@gmail.com>>> wrote:
> >
> >     With my old system, building from source would take 10-15
> minutes.
> >
> >     However, with my new system it takes only 40 seconds.
> >
> >     The hardware is Ryzen 5 3600, B550 motherboard with attached M.2
> >     2280 NVMe SSD.
> >
> >     I ran it once with make -j 6 and it ran in 5 minutes.  Then I
> >     completely deleted the build/mythtv directories and recloned
> >     mythtv.git again. However, this time I used make -j 12.
> >     That seems too good to be true.
> >
> >     Jim A
> >
> >
> > If you want a truly fresh environment to test with, also make
> sure you
> > delete your ~/.ccache directory between builds.
> >
>
> That trashes your ccache config. Use `ccache -C`
>
>
> I was not aware there was a "ccache config". Thanks for the tip.
>

The main use I have for the config is to increase the size of the cache
from its default of 5Gb up to 10Gb, as i build both fixes/31 and master
on a regular basis. If I don't I get a lot more cache misses because the
cache is too small.


Regards
Stuart

_______________________________________________
mythtv-users mailing list
mythtv-users@mythtv.org
http://lists.mythtv.org/mailman/listinfo/mythtv-users
http://wiki.mythtv.org/Mailing_List_etiquette
MythTV Forums: https://forum.mythtv.org