banner ad

Archive for August, 2013

Python fetching URLs popular libraries

Python fetching URLs popular libraries

| August 22, 2013 | 0 Comments

urllib urllib2 Beautiful Soup  –http://www.crummy.com/software/BeautifulSoup/ lxml   http://lxml.de HTQL http://htql.net/ Scrapy  http://scrapy.org/  Mechanize   http://wwwsearch.sourceforge.net/mechanize/ PyQuery  http://pythonhosted.org/pyquery/index.html  requests http://docs.python-requests.org/en/latest/  selenium http://selenium-python.readthedocs.org/en/latest/ httplib httplib2 Ghost.py  https://github.com/jeanphix/Ghost.py Plus a multi-threaded or multi-process + Queue

Continue Reading

Bootstrap 3 released

Bootstrap 3 released

| August 20, 2013 | 0 Comments

For those who haven’t been following along too closely, here’s a recap of all the biggest changes shipping with Bootstrap 3: New design and an optional theme! With v3, we’ve gone flat. Don’t call it a trend—it’s all about customization, folks. Since we simplified the aesthetics though, we thought it’d help to have an optional theme. […]

Continue Reading

Your Python Regular Expression’s Best Buddy

Your Python Regular Expression’s Best Buddy

| August 9, 2013 | 0 Comments

PyRegex is an online Regular Expression tester for python dialect. github:https://github.com/rscarvalho/pyregex Dependency Installation Node.js and Npm – See their websites (2 and 3) about how to get them installed in your platform Grunt: npm install -g grunt-cli Bower: npm install -g bower Nose and its companions: pip install -r requirements.txt (May require sudo or su) For development, please install also pip install -r requirements-dev.txt Assets dependencies: ./install_assets_deps.sh Running the application Just […]

Continue Reading

Scrapy crawl the data stored in MYSQL

Scrapy crawl the data stored in MYSQL

| August 9, 2013 | 0 Comments

Example : Scrapy crawl data classification of the first page books titles and links, and stored in the database. 1 To crawl documents defined in items.py, we want to crawl the book’s name and link 2.pipelines

Continue Reading

Linux System Mining with Python

Linux System Mining with Python

| August 4, 2013 | 1 Comment

In this article, we will explore the Python programming language as a tool to retrieve various information about a system running Linux. Let’s get started. Which Python? When I refer to Python, I am referring to CPython 2 (2.7 to be exact). I will mention it explicitly when the same code won’t work with CPython 3 (3.3) […]

Continue Reading