PHP: Generators
Added to PHP in version 5.5, generators are functions that provide a simple way to loop through data without the need to build an array in memory. Still a bit confused? An example is a good way to show generators in action.
First, let’s quickly create a generator.php file that we will use throughout this tutorial. After creating the file, we add this little code snippet.
When we run this code, output will look like:
Now lets make a little change to our code:
This will end in Fatal error: Allowed memory size of ... byt exhausted ...
. Well, that’s a shame, PHP ran out of memory. Possible solutions that come to mind include going into php.ini and increasing memory_limit. Let’s ask ourselves these questions, is this really effective? Do we want a single script to hog all our server’s memory? The answers are no and no. This is not effective, and we do not want a single script to use up all our memory.
Using Generators
Dissecting the getRange
function, this time, we only loop through the values and yield
an output. yield
is similar to return as it returns a value from a function, but the only difference is that yield
returns a value only when it is needed and does not try to keep the entire dataset in memory.
If you head over to your browser, you should see data being displayed on the page. Given the appropriate time, the browser eventually displays the data.
There are times when we might want to parse a large dataset (it can be log files), perform computation on a large database result, etc. We don’t want actions like this hogging all the memory. We should try to conserve memory as much as possible. The data doesn’t necessarily need to be large — generators are effective no matter how small a dataset is. Don’t forget, our aim is speed while using less memory.
nikic/iter
https://github.com/nikic/iter
This library implements iteration primitives like map() and filter() using generators. To a large part this serves as a repository for small examples of generator usage, but of course the functions are also practically quite useful.
All functions in this library accept arbitrary iterables, i.e. arrays, traversables, iterators and aggregates, which makes it quite different from functions like array_map() (which only accept arrays) and the SPL iterators (which usually only accept iterators, not even aggregates). The operations are of course lazy.
Sources
https://honzabrecka.com/2014/10/26/generatory-v-php.html
https://www.zdrojak.cz/clanky/yield-a-dalsi-novinky-php-5-5/
https://scotch.io/tutorials/understanding-php-generators
https://github.com/nikic/iter