Python Weekly 235

News

SciPy 2016 Call for Talk and Tutorial Proposals
Major topic tracks include: Scientific Computing in Python, Python in Data Science, and High Performance Computing. Mini-symposia will include the applications of Python in: Earth and Space Science, Engineering, Medicine and Biology, Social Sciences, Special Purpose Databases, Case Studies in Industry, Education, Reproducibility.

Join Scrapinghub for Google Summer of Code 2016
It's that time of year again! Google Summer of Code 2016 applications are upon us and we welcome any and all students who are interested in open source and web scraping. For those just hearing about this program, Google Summer of Code provides stipends ($5500 for a successfully completed project) to students who are interested in writing code for open source projects. This is our third year participating in this prestigious program and we're excited to announce projects around Scrapy, Portia, Splash, and Frontera. 


Articles, Tutorials and Talks

A Concrete Introduction to Probability (using Python)
A post by Peter Norvig that covers the basics of probability theory, and show how to implement the theory in Python 3. 

Episode #50: Web scraping at scale with Scrapy and ScrapingHub
What do you do when you are working with an amazing web application that, for whatever reason, doesn't have an API? One option is to say I wish that site had an API and give up. Or, you could use scrapy, an open source web scraping framework from Pablo Hoffman and scrapinghub.com and create your own API! In this episode , we'll talk about how to do this, when it makes sense, and even when it's allowed. 

Diving Into Other People's Code
This post will walk you through an exercise in diving into someone else's code. The goal will be to make an arbitrary change to the code of the Spyder Python IDE, a project I have never touched before in my life, and learn just enough about it to accomplish what I want without getting bogged down. You will learn how to approach problems without the rigour taught in formal education, and instead with guesswork, experimentation, and insight learned in a professional environment. You will see first-hand the joys, sorrows and frustrations trying to navigate the project, culminating in a working (if rough) patch adding a feature to a large, unfamiliar codebase.

Raspberry Pi & Bluetooth LE pt. 3 with Tony D!
This talk demonstrates creating a custom BLE service on a Feather M0 Bluefruit board and then reading data from it over BLE with a Raspberry Pi 3 & Python code.

Podcast.__init__ Episode 48 - PyData with Ian Ozsvald and Emlyn Clay 
Ian Ozsvald and Emlyn Clay are co-chairs of the London chapter of the PyData organization. In this episode we talked to them about their experience managing the PyData conference and meetup, what the PyData organization does, and their thoughts on using Python for data analytics in their work.

Image Processing 101
This article goes through some basic building blocks of image processing, and shares some code and approaches to basic how-tos. All code written is in Python and uses OpenCV. 

Scientific Python for Raspberry Pi
A guide to setting up the Python scientific stack, well-suited for geospatial analysis, on a Raspberry Pi 3.

Develop a Python application with Carina
This tutorial describes how to develop a Python web application locally on VirtualBox and deploy it on Carina with Docker Compose.

Diagnosing Heart Diseases with Deep Neural Networks

Deep-Q learning Pong with Tensorflow and PyGame

Has your conversion rate changed? An introduction to Bayesian timeseries analysis with Python.

Scalable Machine Learning in R and Python with H2O

Exploring SSTI in Flask/Jinja2

Python for geospatial data processing
    

Interesting Projects, Tools and Libraries

match

Match makes it easy to search for images that look similar to each other. Using a state-of-the-art perceptual hash, it is invariant to scaling and 90 degree rotations. Its HTTP API is quick to integrate and flexible for a number of reverse image search applications. Kubernetes and Elasticsearch allow Match to scale to billions of images with ease while giving you full control over where your data is stored. Match uses the awesome ascribe/image-match under the hood for most of the image search legwork.

SecPi
A Raspberry Pi based home alarm system.

pseudo
Pseudo takes an algorithm / a simple program and generates idiomatic code for it in Python, JavaScript, C#, Go and Ruby.

rop_compiler
An open source, multi-architecture ROP compiler written in python.

venv-update
Quickly and exactly synchronize a large python project's virtualenv with its requirements.

megaman
megaman is a scalable manifold learning package implemented in python. It has a front-end API designed to be familiar to scikit-learn but harnesses the C++ Fast Library for Approximate Nearest Neighbors (FLANN) and the Sparse Symmetric Positive Definite (SSPD) solver Locally Optimal Block Precodition Gradient (LOBPCG) method to scale manifold learning algorithms to large data sets. On a personal computer megaman can embed 1 million data points with hundreds of dimensions in 10 minutes. 

hazelnut
A pythonic library to parse /proc/meminfo.

SimpleSQLite
SimpleSQLite is a python library to simplify the table creation and data insertion in SQLite database.

redis-astra
Redis-astra is Python light ORM for Redis.

JSRat-Py
An implementation of JSRat.ps1 in Python so you can run the attack server from any OS instead of being limited to a Windows OS with Powershell enabled.


New Releases

Pandas 0.18
This is a major release from 0.17.1 and includes a small number of API changes, several new features, enhancements, and performance improvements along with a large number of bug fixes.

PyPy 5.0

Twisted 16.0