Source and documentation for a library implementing a simple token scanner.