Mailing List Archive

Re: PyPy performance stats (was Re: Speeding up CPython)
On Wed, Oct 21, 2020 at 10:38 PM Matti Picus <matti.picus@gmail.com> wrote:
>
> On 10/21/20 20:42:02 +1100 Chris Angelico <rosuav@gmail.com>wrote:
>
> > When I go looking for PyPy performance stats, everything seems to be
> > Python 2.7. Is there anywhere that compares PyPy3 to CPython 3.6 (or
> > whichever specific version)? Or maybe it's right there on
> > https://speed.pypy.org/ and I just can't see it - that's definitely
> > possible:)
> >
> > ChrisA
>
>
> They are not on the front page. You can find them, but it requires
> digging around in the Comparison page[0].
>
> - Executables: use only "cpython 3.7.6" and any of the "pypy3-jit-64"
>
> - Chart type: normal bars
>
> - Normalization: cpython3.7.6 or pypy3-jit-64, whichever way makes more
> sense to you
>
> - horizontal.

Ah, cool, got it - thanks! My reading of this is that a good few of
the benchmarks are coming out firmly in PyPy's favour, but a number of
them are still in CPython's favour (including "telco" where PyPy is
staggeringly worse for some reason). But a number of the "PyPy is
worse" benchmarks are ones that seem less significant - for instance,
SQLAlchemy seems to be slower, but if you're using SQLAlchemy, you're
probably more concerned about database performance than the CPU cost
inside Python.

> For some reason the "permalink" feature does not let me share that
> configuration.

Yeah, there seem to be some issues with that page. The first time I
loaded it, the chart was entirely broken - I was looking for the "show
chart" button, but it was just that it had errored out for some
reason. Still, at least the data's there.

> I guess we could switch to emphasizing python3 on the front page, help
> in updating and reconfiguring Codespeed [1] would be awesome.

If only I had infinite time in the day, I'd love to dive in and help
out... It definitely would be worth at least having a quick summary
and link somewhere.

ChrisA
_______________________________________________
Python-Dev mailing list -- python-dev@python.org
To unsubscribe send an email to python-dev-leave@python.org
https://mail.python.org/mailman3/lists/python-dev.python.org/
Message archived at https://mail.python.org/archives/list/python-dev@python.org/message/IP7DXROXIYAV7RXL2JSILON7CBKZYELJ/
Code of Conduct: http://python.org/psf/codeofconduct/
Re: PyPy performance stats (was Re: Speeding up CPython) [ In reply to ]
On Wed, 21 Oct 2020 22:48:59 +1100
Chris Angelico <rosuav@gmail.com> wrote:
>
> Ah, cool, got it - thanks! My reading of this is that a good few of
> the benchmarks are coming out firmly in PyPy's favour, but a number of
> them are still in CPython's favour (including "telco" where PyPy is
> staggeringly worse for some reason).

The "telco" benchmark benefits heavily from the C decimal module written
and ex-maintained by Stefan Krah.

> for instance,
> SQLAlchemy seems to be slower, but if you're using SQLAlchemy, you're
> probably more concerned about database performance than the CPU cost
> inside Python.

I certainly wouldn't say that. The ORM's overhead can be quite
important, and SQLAlchemy has dedicated C extensions to mitigate it.

Regards

Antoine.

_______________________________________________
Python-Dev mailing list -- python-dev@python.org
To unsubscribe send an email to python-dev-leave@python.org
https://mail.python.org/mailman3/lists/python-dev.python.org/
Message archived at https://mail.python.org/archives/list/python-dev@python.org/message/I7WVMX4JO2AKS2LYTBVY7S7MLCNPXKL3/
Code of Conduct: http://python.org/psf/codeofconduct/
Re: PyPy performance stats (was Re: Speeding up CPython) [ In reply to ]
Antoine Pitrou <solipsis@pitrou.net> writes:

> On Wed, 21 Oct 2020 22:48:59 +1100
> Chris Angelico <rosuav@gmail.com> wrote:
>>
>> SQLAlchemy seems to be slower, but if you're using SQLAlchemy, you're
>> probably more concerned about database performance than the CPU cost
>> inside Python.
>
> I certainly wouldn't say that. The ORM's overhead can be quite
> important, and SQLAlchemy has dedicated C extensions to mitigate it.

To be precise, that's unrelated to the ORM layer: the C extension speed ups
the handling of the "records" returned by a database driver, so basically a
custom mixin between a tuple and a dictionary.

ciao, lele.
--
nickname: Lele Gaifax | Quando vivrò di quello che ho pensato ieri
real: Emanuele Gaifas | comincerò ad aver paura di chi mi copia.
lele@metapensiero.it | -- Fortunato Depero, 1929.
_______________________________________________
Python-Dev mailing list -- python-dev@python.org
To unsubscribe send an email to python-dev-leave@python.org
https://mail.python.org/mailman3/lists/python-dev.python.org/
Message archived at https://mail.python.org/archives/list/python-dev@python.org/message/ZWLEY4BJYL4A3ZBBKUIAFXXL62RPFRVB/
Code of Conduct: http://python.org/psf/codeofconduct/
Re: PyPy performance stats (was Re: Speeding up CPython) [ In reply to ]
On 10/21/20 2:38 PM, Matti Picus wrote:
> On 10/21/20 20:42:02 +1100 Chris Angelico <rosuav@gmail.com>wrote:
>
>> When I go looking for PyPy performance stats, everything seems to be
>> Python 2.7. Is there anywhere that compares PyPy3 to CPython 3.6 (or
>> whichever specific version)? Or maybe it's right there on
>> https://speed.pypy.org/  and I just can't see it - that's definitely
>> possible:)
>>
>> ChrisA
>
>
> They are not on the front page. You can find them, but it requires
> digging around in the Comparison page[0].
>
> I guess we could switch to emphasizing python3 on the front page, help
> in updating and reconfiguring Codespeed [1] would be awesome.
>
> Matti
>
>
> [0] https://speed.pypy.org/comparison/
>
> [1] https://github.com/python/codespeed/tree/speed.pypy.org
>

Just as a follow up: the front page of speed.pypy.org now shows the
latest pypy 3.6 vs cpython 3.6.7.

Matti
_______________________________________________
Python-Dev mailing list -- python-dev@python.org
To unsubscribe send an email to python-dev-leave@python.org
https://mail.python.org/mailman3/lists/python-dev.python.org/
Message archived at https://mail.python.org/archives/list/python-dev@python.org/message/2BXQUZO24SZOP2AEQTB3RQNHQWC5APJ6/
Code of Conduct: http://python.org/psf/codeofconduct/
Re: PyPy performance stats (was Re: Speeding up CPython) [ In reply to ]
On Tue, Oct 27, 2020 at 2:42 AM Matti Picus <matti.picus@gmail.com> wrote:
>
>
> On 10/21/20 2:38 PM, Matti Picus wrote:
> > On 10/21/20 20:42:02 +1100 Chris Angelico <rosuav@gmail.com>wrote:
> >
> >> When I go looking for PyPy performance stats, everything seems to be
> >> Python 2.7. Is there anywhere that compares PyPy3 to CPython 3.6 (or
> >> whichever specific version)? Or maybe it's right there on
> >> https://speed.pypy.org/ and I just can't see it - that's definitely
> >> possible:)
> >>
> >> ChrisA
> >
> >
> > They are not on the front page. You can find them, but it requires
> > digging around in the Comparison page[0].
> >
> > I guess we could switch to emphasizing python3 on the front page, help
> > in updating and reconfiguring Codespeed [1] would be awesome.
> >
> > Matti
> >
> >
> > [0] https://speed.pypy.org/comparison/
> >
> > [1] https://github.com/python/codespeed/tree/speed.pypy.org
> >
>
> Just as a follow up: the front page of speed.pypy.org now shows the
> latest pypy 3.6 vs cpython 3.6.7.
>

Thank you! Good to see!

ChrisA
_______________________________________________
Python-Dev mailing list -- python-dev@python.org
To unsubscribe send an email to python-dev-leave@python.org
https://mail.python.org/mailman3/lists/python-dev.python.org/
Message archived at https://mail.python.org/archives/list/python-dev@python.org/message/E357UBOFRIIGWI64ZWOIADN65UQJAQ5K/
Code of Conduct: http://python.org/psf/codeofconduct/
Re: PyPy performance stats (was Re: Speeding up CPython) [ In reply to ]
On 10/26/2020 11:42 AM, Matti Picus wrote:
>
> On 10/21/20 2:38 PM, Matti Picus wrote:

>> [0] https://speed.pypy.org/comparison/

> Just as a follow up: the front page of speed.pypy.org now shows the
> latest pypy 3.6 vs cpython 3.6.7.

I just clicked the link and there is 3.7.6, not 3.6.7. But why not
current cpython?

Since all executables other than pypy 3.6 are checked, no comparisons
are shown, and the chart would be impossible.

The default should be just two executables checked. I am not going to
try to uncheck 50.


--
Terry Jan Reedy
_______________________________________________
Python-Dev mailing list -- python-dev@python.org
To unsubscribe send an email to python-dev-leave@python.org
https://mail.python.org/mailman3/lists/python-dev.python.org/
Message archived at https://mail.python.org/archives/list/python-dev@python.org/message/JJ7DOSJBQ25E7C44JFVKYODYCZ7L3A6P/
Code of Conduct: http://python.org/psf/codeofconduct/