Alexey Bokov's weblog

via Email vs Wiki

• AWS Case Study: U.S. Department of State – ExchangesConnect Video Contest
• RESTful Services with Erlang and Yaws : wting RESTful web services in Erlang/YAWS
• Amazon moves VMware’s virtual machines to the cloud, blog post on AWS :VM Import – Bring Your VMware Images to The Cloud
• Android vs iPhone: Security Models
• Hudson Project Renames to Jenkins – also see Hudson’s future on hudson-labs.org, On Oracle proposal about Hudson by Kohsuke Kawaguchi
• Skype architecture
• Real customers feedback on Agile
• Amazon’s Android Appstore : Amazon launches Android appstore portal, Amazon’s Disruptive Android App Store Now Open To Developers — Full Details, Deciphering Amazon’s Android App Store Strategy
• The coolest open source databases on the planet (NOSQL + RDBMS)
• NoSQL at twitter
• The experiment infrastructure at Google
• Chrome Release Cycle
• Google presented Android 3.0 ( Honeycomb ) on LG /G-Slate device: What’s Hiding Inside Android’s Honeycomb?, and LG and T-Mobile’s G-Slate Tablet To Run Android 3.0 Honeycomb, demo videos from CES :CES 2011: T-Mobile G-Slate Honeycomb LG Tablet Hands-on Videos – Features Walkthrough in 8 New Videos
• Korea : Telecoms bet on cloud computing – SK telecom announced cloud data center for mid- and small-business, other players – KT Corp. and LG Uplus also announced their plans last year to jump into competition.
• CloudBees announced HaaS : Hudson as a Service ( free accounts still available )
• Sony announced ( actually in Nov/2010 ) Sony’s next-gen app platform will use Objective-C/GNUstep: SNAP. By the way Sony got some open source stuff : Sony products with Linux / OSS embedded Technology.

Below I put some snapshots from Googl’e chrome release cycle presentation with some comments.
Continue reading ‘Links for January 2011’ »

• Open Source Search with Lucene & Solr
• Lucene Near Realtime Search
• LinkedIn Search & Lucene
• Distributed Scoring For Lucene Implementation
• Twitter’s New Search Architecture
• Real time search – Billions quieries per day
• Distributed lucene – Katta project
• Does iTunes use Lucene for search?
• Index Server Project Proposal
• NRS – Near Real time search with Lucene
• Solr’s distributed search
• Effective Smoothing for a Terabyte of Text
• Zoie – real time search and indexing based on Lucene
• Distrubuted lucene index on top of Cassandra : Lucandra = Lucene + Cassandra

• Ten Tips for a (Slightly) Less Awful Resume
• How To Sell Agile To Fixed Bid Contract Clients
• AWS Launches Cluster Compute EC2 Instances For High Performance Applications and AWS – High Performance Computing (HPC)

GIT

• git for big files : git-bigfiles
• omit large files commiting into git repo : Rejecting large files in git
• git as backup system : A better backup system based on Git and Journey to a backup solution: Git
• Hosting Git repositories, The Easy (and Secure) Way

Subversion ( svn )

• How to store-all-stuff-in-svn : Subverting your homedir, or keeping your life in svn
• SVN-Hooks : Avoid empty comment in SVN commits
• Using SVN-Hooks to commit notifications on email : Setting up a post-commit mail notification for a Subversion repository
• SVN Notify documentation

• The Web as a graph by Ravi Kumar, Prabhakar Raghavan, Sridhar Rajagopalan,Eli Upfaly, Andrew S. Tomkins
• The Web as a graph: measurements, models, and methods
• Web Graph and PageRank algorithm by Danil Nemirovsky
• Parallel implementation of graph diameter algorithms
• Diameter of the World-Wide-Web
• Fast Computation of Empirically Tight Bounds for the Diameter of Massive Graphs Cl ?mence Magnien 1 , Matthieu Latapy 1 and Michel Habib
• Structural Analysis of the Web
• Small world phenomenon
• Fast Radius Plot and Diameter Computation for Terabyte Graphs (SDM 2010)
• Probabiblistic Counting algorithms for Database applications by Philippe Flajolet
• Philippe Flajolet home page
• HADI: Fast Diameter Estimation and Mining in Massive Graphs with Hadoop
• U Kang personal home page – one of HADI authors
• Data Mining with M AP R EDUCE: Graph and Tensor Algorithms with Applications
• PEGASUS: Mining Peta-Scale Graphs

Here’s some stuff about ( yeah, I know – ‘geeks, stop migrating from svn and git and vise versa – just developer code and don’t spent time on this!‘ ) svn and git comparison.

What do we have : git and svn installed on a same server, empty both svn and git repositories – I will add same data and provide same changes in both repositories,  and also, in another folder, I will checkout how update changes works – so in this tests I’m going to figure out how it works for ‘commiters’ and for ‘those who update changes’. My tests deal with  typical operations with version control systems  – checkout time for adding, pushing and pulling various types of data and checkout how update for them will work – test’s detailed information is below table. For git I use git+ssh protocol, for svn I use svn protocol. I don’t provide any special configuration nor for git nor for svn – all settings is about to be default. Also I would like to note that this tests is partially incomplete – I don’t checkout how delete, branching, merging and some other functions works – so in future I will try to add these points onto this test. Main result of this test – git is faster than svn about a 2-3 times in typical configuration. There’s only one really bad points – git works bad on pretty big files ( > 300 mb size), for some big size ( ~1gb ) it git even can exit with error about memory leak – there’s some special git-related project – like git-bigfiles – this stuff should help you to work with git and big files together.

So – In common we have that git is about 2.6 faster than svn.

I understand that this is may be very non-precious tests and also I don’t check how delete or branching works, but anyway I checkout my own most used operations during this test. In common we can see that git is more than 2 times faster than svn – everything looks fine with git, except one really bad thing  – work with big ( more than 100 mb size ) files – for this type of file svn is really works faster, and for too big ( more than 1 GB files ) git even crashed during ‘git push’ command with ‘fatal: Out of memory, malloc failed‘ message.

Test1 boost 1_43 C++ library :  29135 files and 31609 objects including folders, 286 Mb summary size

Test 3
I just add first line to some cpp files :

find ./ -name "*a???.cpp" -exec sed -i 1i"//test comment `date` : {}" {} \;


Test 5
Change all *.cpp files in the same way :

find ./ -name "*.cpp" -exec sed -i 1i"//big test comment2 `date` : {}" {} \;


Test 7:  Add  real-life repository :  many sources in cpp, perl, erlang, makefiles, bash scripts, MS word documents, images, pdf’s, compiled binaries, resource files, etc,  in sum it contains 4605 files, size is about 2.6G

Test 9:
Refactoring simulation : make to use “std::” specifier for all cerr and cout. Not sure it’s really safe in real-life-development, but it’s okay for test purpose.

find ./ -name "*.h"   -exec sed -i "s/  cerr/std::cerr/g" {} \;
find ./ -name "*.cpp" -exec sed -i "s/ cerr/std::cerr/g" {} \;
find ./ -name "*.cpp" -exec sed -i "s/ cout/std::coutr/g" {} \;


Test 11:  checkout whole project

Test 12: adding 50 mb text file – apache logs

Test 14: adding 72 mb file – many c++ sources concantenated in one big file

Test 16: small xml : 100 mb – xml file sample from real life

Test 18: medium xml : 300 mb – same ( but bigger ) real-life xml fil

Test 20: large xml : 1200 mb – sample of pretty big real-life xml

git push failed with error message of memory leak ( as I can see ) : “fatal: Out of memory, malloc failed”

I collect some usefull information about different source text repositories version control systems : git, svn, cvs, mercury links – take a look on this if you’re interested in different VCS system using.

Since middle of April 2010 I’m work with redmine as corporate wiki in my company – we choose redmine mostly because it’s free, open-source and pretty popular – we don’t need to provide any accounting stuff to buy it officially and in case of some troubles we can find solution in redmine user’s community ( or fix it by ourselft – it’s written on Ruby btw ). As some minus of redmine I can note that redmine don’t really have very detailed documentation – some stuff is skipped and you need to figure out it by yourselft. So in this post I will share my own tips and trick as redmine active user.

• Using anchors in redmine
• Usefull tips for table formatting in redmine
• How to use HTML tags in your redmine wiki documents ?
• Redmine usefull links

Using anchors in redmine

There’s no {anchor} macro in redmine ( Confluence wiki got it btw ) – instead of this you can use h1, h2 or h3 tags ( but not h4 ! ) – header text will be used by redmine as anchor text. Also if your anchor text contains space you need to replace this spaces (in link ) by minus sign. Also I can note that it’s looks that anchor texts isn’t case sensitive. Here’s some examples which can help you figure out it better :
Here’s some anchors from current page to page with name “my test page” which contains anchors “Hello wordl!” and “test”, so page which contain links is looks like :

[[my_test_page#Hello-world|Hello world]] - link to hello world section on my test page
[[my_test_page#test|test]] - link to test section on my test page

And page to which we refer it something about :

h1. Hello world
Some thing about ANSI C.
h2. Test
Something about test>

Again I would like to note that only h1,h2, h3 tags will be treated as anchors, not h4. Also you can’t use header with “!” or “?” because you will have troubles with referring anchor to it ( I mean “h1. Hello world!” won’t create proper anchor is I can see from my experience ).

Usefull tips for table formatting in redmine

Here’s a link : Redmine: Create Tables Using Textile Formatting

How to use HTML tags in your redmine wiki documents ?

It’s really easy – go to file redcloth3.rb ( in my installation it located in /opt/redmine/lib/redcloth3.rb ) and change line onto adding tags which you would like to use. For example to enable <br>
and <a>  it’s enough to change it line which contains ALLOWED_TAGS initialization with your tags. Originally it was ( in my case this stuff located in 1187 line )
ALLOWED_TAGS = %w(redpre pre code notextile)


and I just it change to

ALLOWED_TAGS = %w(redpre pre code notextile br a)

To apply this changes don’t forget to restart web server – after this you will be able to use <a>.. </a> as they should be in HTML your redmine wiki pages. Also allowing tag <a> ( and as result enable <a name=”#my_anchor_text”> )will give an unlimited possibility to put anchors on wiki pages on any place which you like, for example in middle of tables.

Redmine usefull links

• Redmine installation : Zero to Redmine in 22 Steps

Q1: What value will be printed ?
double d1 = 16, d2=2.0;
double d3 = (1/2) * ( sqrt(d1) + d2/2);
cout << d3 << endl;


Q2: Please write your own itoa implementation

Q3: What is pure virtual destructor? Shall ( or can ) pure virtual functions be implemented ?

Q4: Give an example of abort function implementation

Q5: Why we need semicolon after closing bracket in C++ class declaration ?

Q6: Can we call destructor directly? For what we may need it ?

Q7: Can we call constructor directly? For what we may need it ?

Q8: Can we thron an exception in destructor ?

Q9: What happen if we call pure virtual methods in constructor or destructor ? Same question about ‘non-pure’ virtual methods ?

Q10: Why don’t we have virtual constructors in C++ ?

Q11: What is difference between new and new [] ? Same thing about delete and delete [] ?

Q12: What is a difference between static_cast, dynamic_cast, reinterpret_cast and const_cast ?

Q13: Why do we need explicit keyword in C++ ?

Q14: Explain difference between

const MyClass c;
const MyClass &c2 = c;
const MyClass *c2 = &c;
const MyClass * const c2 = &c;


Q15: Difference between const_iterator and iterator

Q16: Implement Rand5 ( which returns randomly 0..4 ) use only Random7 ( which returns 0..6)

Q17: Can we use object of class ( or structure ) which doesn’t have name? Can we declare and use classes and structures without names ?

Q18: What is it factory pattern ?

( to be updated and continued very soon 🙂

Answers ( if you need it 🙂 ) below Continue reading ‘C/C++ interview questions’ »

Some usefull highlights which looks interested for me from Laws of productivity : 8 productivity experiments you don’t need to repeat (if this link doesn’t work please use this link onto copy hosted on bokov.net) – simple thoughts which may help you to organize process better and make it more efficient. Continue reading ‘Laws of productivity : 8 productivity experiments you don’t need to repeat’ »

We have git repo at github (  and would like to move onto some our corporate box inside our network, for example on internal.bokov.net. This repository is shared for group of developers and all who have ssh access onto internal.bokov.net shall have right to commits onto git repository. So first of all prepare place for git repo at new hosting :

ssh user@internal.bokov.net
cd var
mkdir git_repo
chmod 777 git_repo
cd git_repo
mkdir my_project
cd my_project
git init --bare --shared=all
cd objects
chmod g+ws *


Next clone existing repo and change its settings to point onto internal.bokov.net

git clone --bare git@github.com:bokov/github_project.git
git remote add -t master -m master origin ssh://internal.bokov.net/var/git_repo/my_project/
git push origin master


to start work with new repo just use

git clone ssh://internal.bokov.net/var/git_repo/my_project/


have fun.

People at grid.com are talking about open sources- Phases of open source projects ( and SGE as example of top level open source ). This post influenced by Alex Fletcher’s The five phases of maturity for open source software ecosystems. Main idea it’s to divide lifecycle to five separate stages :
* Phase 1: Purely open source stage ( Example : open source implementations of Jingle )
* Phase 2: Entrance into the marketplace ( Example – Untangle )
* Phase 3: Momentum takeoff drives growth ( Example(s) – Alfresco, Funambol, Zimbra )
* Phase 4: Predictability ( Example(s) – Red Hat Linux, MySQL )
* Phase 5: Emergence as full-fledged platform ( Example – Sun Grid Engine )

I’m highly recommending  Alex Fletcher’s blog for anyone who deal with open source project managment – there’s a lot of very interesting analytics.