in NA we have to call them "free libraries" because the concept of not having to pay for something is so rare, it has to be clearly indicated upfront! (joking lol, mostly!!)
Some libraries require membership. Also some people have private libraries. Universities often have libraries which, at least, don’t offer all of their services to the general public.
https://streetlibrary.org.au/
Do they have other names in different countries?