will.brien + python 22
Backup Google Mail GMail / Home / BaGoMa
2 days ago by will.brien
BaGoMa backs-up and restores the contents of a GMail account. It can restore all the labels (folder structure), as well as the flags (seen/read, flagged) of a message. It differs from other similar solutions in a few important ways:
It is Open Source Software. You can read the code to make sure your password and email contents remain private.
Some backup solutions force you to use only ASCII characters in your labels. BaGoMa has no such restrictions on label names. Specifically, foreign characters and '/' (the label hierarchy delimiter) are allowed.
BaGoMa is tuned to work specifically with GMail. Each message is only downloaded and saved once. Backup solutions that are designed to work with regular IMAP accounts will download each message multiple times (once per label) when used to back up a GMail account. That can significantly increase the bandwidth requirements and the amount of storage required for backup. Additionally, a faithful restoration of your GMail account might not be possible from such a backup.
BaGoMa requires your GMail account to be IMAP accessible. Check the Mail Settings and make sure "Enable IMAP" is selected under the "Forwarding and POP/IMAP" tab. In the "Folder Size Limits" section on the same tab, make sure the following option is selected: "Do not limit the number of messages in an IMAP folder".
BaGoMa never deletes any email from your account. A restore simply compares the contents of your local backup with the contents of your GMail account, and uploads any messages missing from your GMail account. It never deletes messages from GMail to make it match the local backup.
Google sometimes imposes limits on how much data can be transfered from your account. If you run into such a limitation, just wait a few days and try the backup again. BaGoMa will pick up from where it left off. If the temporary loss of IMAP access is critical to you, think twice before using this script. As far as I'm aware, web access to your email should continue unimpeded even if IMAP access is blocked.
google
mail
backup
python
cli
linux
documentation
software
<todo>
It is Open Source Software. You can read the code to make sure your password and email contents remain private.
Some backup solutions force you to use only ASCII characters in your labels. BaGoMa has no such restrictions on label names. Specifically, foreign characters and '/' (the label hierarchy delimiter) are allowed.
BaGoMa is tuned to work specifically with GMail. Each message is only downloaded and saved once. Backup solutions that are designed to work with regular IMAP accounts will download each message multiple times (once per label) when used to back up a GMail account. That can significantly increase the bandwidth requirements and the amount of storage required for backup. Additionally, a faithful restoration of your GMail account might not be possible from such a backup.
BaGoMa requires your GMail account to be IMAP accessible. Check the Mail Settings and make sure "Enable IMAP" is selected under the "Forwarding and POP/IMAP" tab. In the "Folder Size Limits" section on the same tab, make sure the following option is selected: "Do not limit the number of messages in an IMAP folder".
BaGoMa never deletes any email from your account. A restore simply compares the contents of your local backup with the contents of your GMail account, and uploads any messages missing from your GMail account. It never deletes messages from GMail to make it match the local backup.
Google sometimes imposes limits on how much data can be transfered from your account. If you run into such a limitation, just wait a few days and try the backup again. BaGoMa will pick up from where it left off. If the temporary loss of IMAP access is critical to you, think twice before using this script. As far as I'm aware, web access to your email should continue unimpeded even if IMAP access is blocked.
2 days ago by will.brien
Google Python Style Guide
6 weeks ago by will.brien
Parting Words: BE CONSISTENT.
If you're editing code, take a few minutes to look at the code around you and determine its style. If they use spaces around all their arithmetic operators, you should too. If their comments have little boxes of hash marks around them, make your comments have little boxes of hash marks around them too.
The point of having style guidelines is to have a common vocabulary of coding so people can concentrate on what you're saying rather than on how you're saying it. We present global style rules here so people know the vocabulary, but local style is also important. If code you add to a file looks drastically different from the existing code around it, it throws readers out of their rhythm when they go to read it. Avoid this.
python
reference
programming
google
lists
If you're editing code, take a few minutes to look at the code around you and determine its style. If they use spaces around all their arithmetic operators, you should too. If their comments have little boxes of hash marks around them, make your comments have little boxes of hash marks around them too.
The point of having style guidelines is to have a common vocabulary of coding so people can concentrate on what you're saying rather than on how you're saying it. We present global style rules here so people know the vocabulary, but local style is also important. If code you add to a file looks drastically different from the existing code around it, it throws readers out of their rhythm when they go to read it. Avoid this.
6 weeks ago by will.brien
Evolution of a Web Developer: From PHP Newbie To Python Ninja
6 weeks ago by will.brien
Some of you may have come out of the womb hacking shell scripts to disable that Internet-enabled baby video surveilliance monitor that your parents used to watch what you're doing on their iPad in the kitchen (visualize eTrade baby hacking away on a terminal app on his Android phone). But, I suspect most of us started more modestly than that and moved up the learning curve (some faster than others). The following is a somewhat fictional, somewhat true recollection.
education
reference
diy
php
python
javascript
linux
<todo>
6 weeks ago by will.brien
web2py Web Framework
9 weeks ago by will.brien
Free open source full-stack framework for rapid development of fast, scalable, secure and portable database-driven web-based applications. Written and programmable in Python.
programming
python
opensource
<todo>
9 weeks ago by will.brien
List of resources: Article text extraction from HTML documents
12 weeks ago by will.brien
Following up to my overview of article text extractors, I’ll try to compile a list of research papers, articles, web APIs, libraries and other software that I encountered during my research.
datamining
python
html
rss
cli
linux
12 weeks ago by will.brien
ScraperWiki
july 2011 by will.brien
ScraperWiki is an online tool to make that process simpler and more collaborative. Anyone can write a screen scraper using the online editor. In the free version, the code and data are shared with the world. Because it's a wiki, other programmers can contribute to and improve the code.
datamining
reference
python
api
google
diy
july 2011 by will.brien
Learn Python The Hard Way
march 2011 by will.brien
This is the site for the book "Learn Python The Hard Way". The book is a very beginner book for people who want to learn to code. If you can already code then the book will probably drive you insane. It's intended for people who have no coding chops to build up their skills before starting a more detailed book.
education
programming
python
documentation
tutorials
reference
march 2011 by will.brien
Pattern | CLiPS
march 2011 by will.brien
Pattern is a web mining module for the Python programming language.
It bundles tools for data retrieval (Google + Twitter + Wikipedia API, web spider, HTML DOM parser), text analysis (rule-based shallow parser, WordNet interface, syntactical + semantical n-gram search algorithm, tf-idf + cosine similarity + LSA metrics) and data visualization (graph networks).
The module is bundled with 30+ example scripts.
python
linux
cli
database
archives
datamining
It bundles tools for data retrieval (Google + Twitter + Wikipedia API, web spider, HTML DOM parser), text analysis (rule-based shallow parser, WordNet interface, syntactical + semantical n-gram search algorithm, tf-idf + cosine similarity + LSA metrics) and data visualization (graph networks).
The module is bundled with 30+ example scripts.
march 2011 by will.brien
PDFMiner
february 2011 by will.brien
PDFMiner is a tool for extracting information from PDF documents. Unlike other PDF-related tools, it focuses entirely on getting and analyzing text data. PDFMiner allows to obtain the exact location of texts in a page, as well as other information such as fonts or lines. It includes a PDF converter that can transform PDF files into other text formats (such as HTML). It has an extensible PDF parser that can be used for other purposes instead of text analysis.
linux
cli
python
scripts
documentation
government
ireland
html
february 2011 by will.brien
Django | The Web framework for perfectionists with deadlines
february 2011 by will.brien
Meet Django
Django is a high-level Python Web framework that encourages rapid development and clean, pragmatic design.
Developed four years ago by a fast-moving online-news operation, Django was designed to handle two challenges: the intensive deadlines of a newsroom and the stringent requirements of the experienced Web developers who wrote it. It lets you build high-performing, elegant Web applications quickly.
Django focuses on automating as much as possible and adhering to the DRY principle.
linux
programming
python
Django is a high-level Python Web framework that encourages rapid development and clean, pragmatic design.
Developed four years ago by a fast-moving online-news operation, Django was designed to handle two challenges: the intensive deadlines of a newsroom and the stringent requirements of the experienced Web developers who wrote it. It lets you build high-performing, elegant Web applications quickly.
Django focuses on automating as much as possible and adhering to the DRY principle.
february 2011 by will.brien
FlexGet
june 2010 by will.brien
FlexGet is a multipurpose automation tool for content like torrents, nzbs, podcasts, comics, etc. FlexGet is able to handle different kinds of sources like RSS-feeds, html pages and even csv files. There are even some plugins for sites that do not provide any kind of useful feeds.
There are numerous plugins that allow utilizing FlexGet in interesting ways and more are being added continuously.
FlexGet is extremely useful in conjunction with applications which have watch directory support.
software
programming
rss
scripts
python
bittorrent
television
comics
There are numerous plugins that allow utilizing FlexGet in interesting ways and more are being added continuously.
FlexGet is extremely useful in conjunction with applications which have watch directory support.
june 2010 by will.brien
Google's Python Class - Google's Python Class - Google Code
may 2010 by will.brien
Welcome to Google's Python Class -- this is a free class for people with a little bit of programming experience who want to learn Python. The class includes written materials, lecture videos, and lots of code exercises to practice Python coding. These materials are used within Google to introduce Python to people who have just a little programming experience. The first exercises work on basic Python concepts like strings and lists, building up to the later exercises which are full programs dealing with text files, processes, and http connections. The class is geared for people who have a little bit of programming experience in some language, enough to know what a "variable" or "if statement" is. Beyond that, you do not need to be an expert programmer to use this material.
python
education
tutorials
programming
google
reference
may 2010 by will.brien
Installation — PyGoogleVoice v0.5 documentation
april 2010 by will.brien
Here is how to integrate Google Voice with a PBX. This guide was designed for PBX in a flash, which is built upon Asterisk.
The first steps are to install PBX in a flash. Here is a good guide for doing so:
http://knol.google.com/k/ward-mundy/pbx-in-a-flash/
Running the setup above copies over a setup script to integrate into your Asterisk configuration setup. Simply run
$ asterisk-gvoice-setup
answer a couple questions, then restart your PBX instance.
python
code
telephony
voip
programming
google
cli
reference
The first steps are to install PBX in a flash. Here is a good guide for doing so:
http://knol.google.com/k/ward-mundy/pbx-in-a-flash/
Running the setup above copies over a setup script to integrate into your Asterisk configuration setup. Simply run
$ asterisk-gvoice-setup
answer a couple questions, then restart your PBX instance.
april 2010 by will.brien
outbound calls via Google Voice | trixbox
april 2010 by will.brien
Nerdvittles published a article on how to make free outbound calls via google voice and Asterisk. Has anyone tried this yet? If so was it successful?
I have followed the instructions but can seem to get it to work. It looks like outbound calls is fine I even see the call setting up in a confrence bridge but the far end never rings..
Also I am a little confused on why do I need two DIDs set up with my google voice account. This could be why it isnt working. but I have one DID poined to a meetme confrence bridge. What do I do with the 2nd DID?
Thanks
Dan
python
code
telephony
voip
programming
google
cli
reference
I have followed the instructions but can seem to get it to work. It looks like outbound calls is fine I even see the call setting up in a confrence bridge but the far end never rings..
Also I am a little confused on why do I need two DIDs set up with my google voice account. This could be why it isnt working. but I have one DID poined to a meetme confrence bridge. What do I do with the 2nd DID?
Thanks
Dan
april 2010 by will.brien
pygooglevoice - Google Voice for Python
april 2010 by will.brien
This project aims to bring the power of the Google Voice API to the Python language in a simple, easy-to-use manner. Currently it allows you to place calls, send sms, download voicemails/recorded messages, and search the various folders of your Google Voice Accounts. You can use the Python API or command line script to schedule calls, check for new received calls/sms, or even sync your recorded voicemails/calls. Works for Python 2 and Python 3.
python
code
telephony
voip
programming
google
cli
april 2010 by will.brien
Specto
november 2009 by will.brien
Specto is a desktop application that will watch configurable events (such as website updates, emails, file and folder changes, system processes, etc) and then trigger notifications.
For example, Specto can watch a website for updates (or a syndication feed, or an image, etc), and notify you when there is activity (otherwise, Specto will just stay out of the way). This changes the way you work, because you can be informed of events instead of having to look out for them. Better than clicking the refresh button on Caturdays, huh?
Specto is free and open source software distributed under the GNU GPL license.
linux
ubuntu
software
tools
python
backup
archives
For example, Specto can watch a website for updates (or a syndication feed, or an image, etc), and notify you when there is activity (otherwise, Specto will just stay out of the way). This changes the way you work, because you can be informed of events instead of having to look out for them. Better than clicking the refresh button on Caturdays, huh?
Specto is free and open source software distributed under the GNU GPL license.
november 2009 by will.brien
Beautiful Soup: We called him Tortoise because he taught us.
october 2009 by will.brien
Beautiful Soup is a Python HTML/XML parser designed for quick turnaround projects like screen-scraping. Three features make it powerful:
1. Beautiful Soup won't choke if you give it bad markup. It yields a parse tree that makes approximately as much sense as your original document. This is usually good enough to collect the data you need and run away.
2. Beautiful Soup provides a few simple methods and Pythonic idioms for navigating, searching, and modifying a parse tree: a toolkit for dissecting a document and extracting what you need. You don't have to create a custom parser for each application.
3. Beautiful Soup automatically converts incoming documents to Unicode and outgoing documents to UTF-8. You don't have to think about encodings, unless the document doesn't specify an encoding and Beautiful Soup can't autodetect one. Then you just have to specify the original encoding.
linux
ubuntu
software
cli
python
html
programming
xml
tools
opensource
1. Beautiful Soup won't choke if you give it bad markup. It yields a parse tree that makes approximately as much sense as your original document. This is usually good enough to collect the data you need and run away.
2. Beautiful Soup provides a few simple methods and Pythonic idioms for navigating, searching, and modifying a parse tree: a toolkit for dissecting a document and extracting what you need. You don't have to create a custom parser for each application.
3. Beautiful Soup automatically converts incoming documents to Unicode and outgoing documents to UTF-8. You don't have to think about encodings, unless the document doesn't specify an encoding and Beautiful Soup can't autodetect one. Then you just have to specify the original encoding.
october 2009 by will.brien
PulseSource - jmason.org Wiki
october 2009 by will.brien
IrishPulse is a "microplanet" for Irish Twitter users, similar to Portland's Pulse of PDX -- an aggregator of the "stream of consciousness" that comes out of our local Twitter community.
software
linux
ubuntu
cli
python
perl
tools
opensource
programming
twitter
october 2009 by will.brien
Planet Venus
october 2009 by will.brien
Planet Venus is an awesome ‘river of news’ feed reader. It downloads news feeds published by web sites and aggregates their content together into a single combined feed, latest news first.
software
linux
ubuntu
cli
python
tools
opensource
programming
rss
twitter
october 2009 by will.brien
Copacetic » Blog Archive » Python Program to scrape the CRO Database
october 2009 by will.brien
I’ve spent a lot of time looking at the CRO database in the past few weeks, so I wrote this python script called croscraper.py to do a quick lookup on companies.
python
scripts
cli
linux
government
ireland
documentation
search
october 2009 by will.brien
Dive Into Python
july 2009 by will.brien
Dive Into Python is a Python book for experienced programmers. You can buy a printed copy, read it online, or download it in a variety of formats. It is also available in multiple languages.
programming
books
tutorials
documentation
reference
python
linux
cli
july 2009 by will.brien
Webstemmer
july 2007 by will.brien
Webstemmer is a web crawler and HTML layout analyzer that automatically extracts main text of a news site without having banners, ads and/or navigation links mixed up.
python
cli
programming
code
scripts
software
search
backup
july 2007 by will.brien
related tags
<todo> ⊕ api ⊕ archives ⊕ backup ⊕ bittorrent ⊕ books ⊕ cli ⊕ code ⊕ comics ⊕ database ⊕ datamining ⊕ diy ⊕ documentation ⊕ education ⊕ google ⊕ government ⊕ html ⊕ ireland ⊕ javascript ⊕ linux ⊕ lists ⊕ mail ⊕ opensource ⊕ perl ⊕ php ⊕ programming ⊕ python ⊖ reference ⊕ rss ⊕ scripts ⊕ search ⊕ software ⊕ telephony ⊕ television ⊕ tools ⊕ tutorials ⊕ twitter ⊕ ubuntu ⊕ voip ⊕ xml ⊕Copy this bookmark: