skip to navigation
skip to content

textdata 0.015

Get clean line or text data from multi-line strings

Latest Version: 1.6.1

It’s very common to need to extract text or text lines from within program source. The way Python likes to have its text indented, however, means that there will often be extra spaces appended to the beginning of each line, as well as possibly extra lines at the start and end of the text that are there for inclusion in the program source, but not useful in the resulting data.

Python string methods give easy ways to clean this text up, but it’s no joy reinventing that particular text-cleanup wheel every time you need it.

This module helps clean up included text (or text lines) in a simple, reusuable way that won’t muck up your programs with extra code, or require constant wheel-reinvention.


data = lines("""
    There was an old woman who lived in a shoe.
    She had so many children, she didn't know what to do;
    She gave them some broth without any bread;
    Then whipped them all soundly and put them to bed.

will result in:

['There was an old woman who lived in a shoe.',
 "She had so many children, she didn't know what to do;",
 'She gave them some broth without any bread;',
 'Then whipped them all soundly and put them to bed.']

If instead you used textlines(), the result is the same, but joined by newlines into into a single string:

"There was an old woman who lived in a shoe.\nShe ... to bed."
# where the ... abbreviates exactly the characters you'd expect
Both routines provide typically-desired cleanups:
  • remove blank lines default), but at least first and last blanks (which usually appear due to Python formatting)
  • remove common line prefix (default)
  • strip leading/trailing spaces (leading by request, trailing by default)


lines(text, noblanks=True, dedent=True, lstrip=False, rstrip=True)

Returns text as a series of cleaned-up lines.

  • text is the text to be processed.

  • noblanks => all blank lines are eliminated, not just starting and ending ones. (default True).

  • dedent => strip a common prefix (usually whitespace) from each line (default True).

  • lstrip => strip all left (leading) space from each line (default False). Note

    that lstrip and dedent are mutualy exclusive ways of handling leading space.

  • rstrip => strip all right (trailing) space from each line (default True)

textlines(text, noblanks=True, dedent=True, lstrip=False, rstrip=True)

Does the same helpful cleanups as lines(), but returns result as a single string, with lines separated by newlines (and without a trailing newline).

Design Notes

It’s tempting to define a constant such as Dedent that might be the default for the lstrip parameter, instead of having separate dedent and lstrip booleans. The more I use singleton classes in Python as designated special values, the more useful they seem.


pip install textdata

(You may need to prefix this with “sudo ” to authorize installation.)

File Type Py Version Uploaded on Size
textdata-0.015.tar.gz (md5) Source 2012-09-21 3KB (md5) Source 2012-09-21 8KB