python-textops 0.0.9

Introduction

python-textops provides many text operations at string level, line level or whole text level. These operations can be chained with the ‘dotted’ notation. You can also build a lazy filter object to apply operations after their definition.

Quickstart

To install:

pip install python-textops

Usage:

from textops import *

# To create a lazy operation filter, do not specify an input text
# here a filter to find the first line with an error and put it in uppercase :
myfilter = grepi('error').first().upper()

# To execute the filter :
print myfilter('this is an error')

# To execute operations at once, specify the input text:
print grepi('error').first().upper()('this is an error')

or use the pipe symbol (the bitwise operator has been redefined):
print 'this is an error'|grepi('error').first().upper()

# your text can have multiple lines :
print 'this is an error\nthis is a warning'|grepi('error').first().upper()

# or can be a list :
print ['this is an error','this is a warning']|grepi('error').first().upper()

# To execute ops at once AND avoid python generator to be used,
# you can use textops Extended types (StrExt, ListExt, DictExt) to gain access to ops on str, list and dict:
s = StrExt('this is an error\nthis is a warning')
print s.grepi('error').first().upper()

# textops works also on list of list (you can grep on a specific column) :
print ListExt([['this is an','error'],['this is a','warning']]).grepi('error',1).first().upper()

# ... or a list of dict (you can grep on a specific key) :
print ListExt([{ 'msg':'this is an', 'level':'error'},{'msg':'this is a','level':'warning'}]).grepi('error','level').first()

# DictExt has got the attribute access functionnality :
d = DictExt({ 'a' : { 'b' : 1}})
print d.a.b

# If attributes are reserved or contains space, one can use normal form :
d = DictExt({ 'this' : { 'is' : { 'a' : {'very deep' : { 'dict' : 'yes it is'}}}}})
print d.this['is'].a['very deep'].dict

# You can use dotted notation for setting information in dict BUT only on one level at a time :
d = DictExt()
d.a = DictExt()
d.a.b = 2

Example

# Lazy chained ops example (optimized for huge file):
find_errors = cat().range('2014','2016').grepi(r'error|critical').cut(':')
for date,level,msg in find_errors('my_log_file.log'):
    print 'date = %s, level = %s : %s' % (date,level,msg)

OR

# 'Executed at once' chained ops example,
# uses textops Extended type "StrExt" (Not optimized for big files) :
logs = StrExt(open('my_log_file.log').read())
errors = logs.range('2014','2016').grepi(r'error|critical').cut(':')
for date,level,msg in errors:
    print 'date = %s, level = %s : %s' % (date,level,msg)

# Example of my_log_file.log:

2013-03-01:Info:textops rocks
2014-11-01:Info:you can also use pipe symbole to inject data in the ops
2015-05-22:Error:textops can manage huge file
2015-07-23:Critical:it uses generators along the chained ops when possible
2016-09-12:Info:textops provides extended basic types : StrExt, DictExt, ListExt, UnicodeExt

# Result:

date = 2015-05-22, level = Error : textops can manage huge file
date = 2015-07-23, level = Critical : it uses generators along the chained ops when possible

Available operations :

0.0.2 (2015-04-03)

Still developping…