Comment on Python Performance: Why 'if not list' is 2x Faster Than Using len()

gigachad@sh.itjust.works ⁨4⁩ ⁨weeks⁩ ago

• iknowitwheniseeit@lemmynsfw.com ⁨4⁩ ⁨weeks⁩ ago

  You’d need to explicitly check for None if using the len() construct as well, so this doesn’t change the point of the article.

  source

  • gigachad@sh.itjust.works ⁨4⁩ ⁨weeks⁩ ago

    But None has no len

    if not foo:  
    

    -> foo could be an empty list or None, it is ambiguous.

    len(foo) will lead to an exception TypeError, I can cleanly catch that.

    It suggests I deal with a boolean when that is not the case. Explicit is better than inplicit, and if not foo to check for an empty list may be pythonic, but it’s still implicit af

    source

    • sugar_in_your_tea@sh.itjust.works ⁨4⁩ ⁨weeks⁩ ago

      it’s still implicit

      I don’t see it that way. If you’re doing if len(foo) == 0, you’re implying that foo is expected to not be None, and expecting an exception should not be the default assumption, because exceptions should be… exceptional.

      Here’s what I assume:

      • if foo is not None - empty values are explicitly acceptable
      • if not foo - the difference between an empty and None value isn’t important
      • if len(foo) == 0 - implicit assumption that foo is not None (I frequently forget that len(…) raises on None)

      If an exception was intended by the last bullet point, I prefer an explicit raise:

      if foo is None:
          raise ValueError("foo may not be None")
      

      I actually use schema validation to enforce this at the edge so the rest of my code can make reasonable assumptions, and I’m explicit about whether each field may or may not be None.

      source
    • iknowitwheniseeit@lemmynsfw.com ⁨4⁩ ⁨weeks⁩ ago

      My point is that if your variable can be None then you need the same pattern for the length check.

      So for the Pythonic version:

      if (foo is not None) and not foo:
         ...
      

      For the explicit length check:

      if (foo is not None) and (len(foo) == 0):
        ...
      

      Honestly you’re probably better off using type hints and catching such things with static checks and not adding the None check.

      source

      • gigachad@sh.itjust.works ⁨4⁩ ⁨weeks⁩ ago

        This is what I would come up with:

        try:
            if len(foo) == 0:
            ...
        except TypeError:
            ...
        

        There is no need to add a None check, as foo being None should be considered as a faulty input. Avoiding the possibility of foo being None from the beginning using static checks or testing is of course the preferred solution. But in reality we do not work in such optimal environments, at least I can say that from the perspective of data science, where often procedural, untested code is produced that runs only a few times. But I get your point and I think both paths are viable, maybe we can agree on that :)

        source

        • -> View More Comments
    • mint_tamas@lemmy.world ⁨4⁩ ⁨weeks⁩ ago

      Apart from the quote from the zen of python, does this really make your code better though? You will end up writing 4-5 lines with an extra level of indentation. The code does the same, but has worse performance and communicates the intent poorly (compared to the “pythonic” version).

      source

      • gigachad@sh.itjust.works ⁨4⁩ ⁨weeks⁩ ago

        I am not saying it’s better, just that I don’t like the proposed way :) I would argue that being “pythonic” has even less value than the Zen, which I quoted because it’s true, not because it is some strict rule (which it isn’t anyway).

        You could argue I also need to write that extra code for the if not case, as I explicitly have to check if it is None if my program somewhere further down expects only lists.

        Hunting for those sweet milliseconds is a popular game in the Python community ;) if this mechanism is that important for your program, you should definitely use it, I would do as well!

        source

        • -> View More Comments