Saturday, February 08, 2014

Installing SimpleCV on Windows 7 64bit

SimpleCV (http://simplecv.org/) is the easiest way to use OpenCV (http://opencv.org/).  There is a python module for OpenCV, but SimpleCV really simplifies the use of it.
On SimpleCV's site, there is "SimpleCV Superpack" that includes everything to use SimpleCV, but I wanted to use my existing Python 64-bit installation and don't want to manage another copy of Python install.

When I tried to install SimpleCV after checking out from its Git repository, of course it didn't work -- I have to install many dependent python modules.  This is a bit too much -- I do not want to spend my time installing all the dependent modules, which requires sometimes C/C++ compilation.  Here is a simple tip/trick to avoid the all the hassle:
  1. Make sure you already installed OpenCV and configured properly.
  2. Install OpenCV module for Windows 64bit from this site, http://www.lfd.uci.edu/~gohlke/pythonlibs/#opencv -- it shows what modules are dependent and all the dependent pre-compiled modules are available on the same site.  And install PILLOWS module from the site.
  3. Make sure your Python for OpenCV works.
  4. Check out SimpleCV from its Git repository (https://github.com/sightmachine/SimpleCV)
  5. Modify "setup.py" -- remove "PIL" requirement from "requires=" line in that file.  Make sure you have installed "Pillows" module from step #2.  Pillows module replaces PIL module.
  6. Run setup.
This does the trick.  Now my one Python installation has all the modules I want to use together in one place.

Picture thumbnails but not for videos

I'm using Windows 7 64bit and sometimes opening folder becomes very slow and copying/moving video files hang in the middle of the copying/moving process.  I noticed that if I check off "Always show icons, never thumbnails" option in Folder Options this problem doesn't occur.  I searched on this issue and read many posts -- indeed one of the solutions is to disable showing thumbnails, and another solution is in the properties of the folder containing videos, click on the tab "customize" -> then change "optimize this folder" to "general."
Tried both but I found that changing "customize" in properties is a real hassle to change all the folders that contains video files, and not seeing thumbnails is inconvenient as there are lots of pictures without meaningful file names that my camera created.
I save video files from Courera online courses for later viewing, and the file names has meaningful descriptions so I don't need thumbnails for videos, but for pictures, I want to have thumbnails view.  Unfortunately, the file explorer's option is either turn on or off thumbnails view for both pictures and videos.
One solution I found and settled on is:
  1. Turn off thumbnails view in folder's view options.
  2. Use 3rd party software, SageThumbs (https://code.google.com/p/sagethumbs/)
This combination gives me exactly what I want -- no thumbnails for videos, but thumbnails for pictures.
I hope this post is helpful for anyone experiencing  the same issue and having the same needs.

Friday, December 20, 2013

Apache BigTop (Hadoop ecosystem installation)

Installing all Hadoop and related software is a painful experience.  For development environment, it's probably the easiest to use BigTop.  The site explains it as:
    Bigtop  
    Bigtop is a project for the development of packaging and tests of the Apache Hadoop ecosystem.

    The primary goal of Bigtop is to build a community around the packaging and interoperability testing of Hadoop-related projects. This includes testing at various levels (packaging, platform, runtime, upgrade, etc...) developed by a community with a focus on the system as a whole, rather than individual projects.
Installing all the Hadoop and related software can take days and weeks -- Hadoop/Yarn, ZooKeeper, Pig, Hive, HBase, Mahout, Whirr, Oozie, Sqoop, Hue, Flume...etc.  And BigTop make it possible to install most of them very quickly (like about an hour or less).

You just need to make sure you to meet all the requirements and follow the steps correctly.  I've done this for CentOS 6.3 64-bit and worked fine. 

Requirements - http://bigtop.apache.org/
Install Steps - https://cwiki.apache.org/confluence/display/BIGTOP/How+to+install+Hadoop+distribution+from+Bigtop+0.6.0

The latest version is 0.7.0, so for the first step, I did this:

  1. sudo wget -O /etc/yum.repos.d/bigtop.repo http://bigtop.s3.amazonaws.com/releases/0.7.0/redhat/6/x86_64/bigtop.repo
  2. sudo yum install hadoop\* flume-* mahout\* oozie\* whirr-* hive\* hue\*
I haven't tested this thoroughly, and it's for single-server environment setup.  For cluster setup, I'm still going to do manually -- I have to know how the systems are structured and what configuration files are involved and located anyway. For development, this seems to be the way to go for quick set up.


Tuesday, December 10, 2013

Bitcoin flow in realtime

You can watch bitcoin flow in realtime.  Pretty cool.  I wonder why CN is getting so much despite China bans it.

http://fiatleak.com/ - "watch the world currencies flow into BTC in realtime"


Top