Thought for the day

I satisfy myself by saying, "My every attempt at failing to solve a problem and learning from it, is equivalent to Edison trying a new filament" :)

Balbir Singh

Thought for the day

Be willing to be questioned till the right thought emerges and be willing to question till the right answer emerges

Balbir Singh

Feeling insecure - thoughts on SELinux

I've decided to run Fedora on my main desktop and enable other distros via virtualization. Yes, too many good solutions to ignore and I paid for the hardware. Anyway, this is not an entry about virtualization, but on SELinux. Fedora enables SELinux by default and I was left to live with the consequences. To try and make sure I get the same five star security on my desktop that enterprise applications get, I decided not to add selinux=0 to the boot command prompt.

I thought I could learn it, wouldn't I be an inferior being if I could not? What does it say about my go-getter attitude? My first encounter with SELinux was when I tried to get ~user/public_html enabled via the Apache Web Server. After I had followed the documentation, I still could not get a seemingly easy feature to work. I dig the web and without knowing too much, I learn about a certain context httpd_user_context_t and use a certain tool and it worked!!!

I had a grin on my face for a few days, I was going to be able to work with SELinux. My next surprise came when I tried to install some software and setroubleshootd very gently pointed me to the cause of the security violation while installing the software and what I could do to fix it (gee, an automated tool, no more worries). My next encouter occurred when I tried to install mediawiki with math enabled (yeah.. I decided to save paper and take notes on the wiki with TeX enabled, but that is a different story). Again, no matter how well I followed the guidelines, I could not get texvc to work :(

Remember to look at /var/log/audit files as root and run audit2allow to get some useful hints with SELinux. SELinux comes with a set of rich GUI tools, be sure to use them as you walk through the seemingly friendly maze of SELinux

I found some help on the mediawiki site that gave me instructions on how to setup SELinux and mediawiki together. To my surprise, I found quite a few software vendors providing additional instructions for setup when SELinux is enabled.

The feeling of being miserable at SELinux set in, I had to now read up and understand the architecture or forgo my new found security infrastructure. Today, I came across a very interesting web page (the wikipedia entry for SELinux),

“...given the threat models and capabilities of the adversaries involved, that's probably appropriate... But that’s not necessarily appropriate for all users. SELINUX is so horrible to use, that after wasting a large amount of time enabling it and then watching all of my applications die a horrible death since they didn't have the appropriate hand-crafted security policy, caused me to swear off of it. For me, given my threat model and how much my time is worth, life is too short for SELinux.” — Theodore Ts’o

You can only imagine how relieved I was to see this quote

Life is too short for SELinux

I was not alone, others hated it and found it hard to use as well. How pathetic can such happiness be, but I was overjoyed, excited to say the least.

My path forward is to continue to use SELinux, but be less tolerant of its idiosyncrasies. I am working my way through the documentation, but very slowly. I've learnt that my new best friend is "Z". Add "Z" to existing commands in Fedora and magically it shows SELinux information that can be a life saviour at times.

Search engine, BIOS updates and a waste of time

I am not quite sure how, but the default search engine on my Windows partition changed to "Ask". I was looking for BIOS updates as a possible workaround to some 3D graphic issues I was observing. The search showed a wrong version of the BIOS and board and I (being me) ran the .exe express update only to realize that I've managed to erase out my Intel Management Agent firmware. The BIOS worked, but I could no longer read the temperature and voltage from the motherboard sensors.

After this blunder, the regular express or ISO based mechanism of BIOS update refused to work. Thanks to the recovery BIOS mechanism on my Intel board, I removed the jumper pins (see manual for your BIOS), put in the CD with .bio file burnt on it.

NOTE:

1. .bio is the recover BIOS. Burning
2. .bio from Windows burner created a UDF filesystem on the CD, which the failed to work.

I had to force a iso9660 file format from my Linux partition and recover. After the recovery BIOS update, I put back the jumper pins and got back to normal work. My Intel 3D graphics problem on Linux is not yet completely gone, but I do hope to debug it more and not hear back (update BIOS) when I ask for help

In summary, stop believing your search results if you want to be productive :)

No.. I've not given up blogging

Just too busy collecting stuff to write about. Many interesting things, many learning's, mistakes and successes. Watch out, something might be coming soon.

I've got a twitter home as well, but twitter is like a light snack and blogging is like a full meal.

Negative Binomial Coefficient

While reading through a book on probability and calculating the expectation of geometric series, I came across an interesting sum
We know that if then the sum converges to


Coming from the other side and using binomial theorem we getwhich expands to



Which leads to an interesting conclusion

I got maxima to verify this by calling the binomial function for various combinations of -1 and n. I am a little confused about the interpretation of the meaning though

Usually nC2 is used to imply from "n" objects, choose 2 at a time. nC2 gives us the number of total such combinations. What does -1Cn mean? What are the other proofs for -1Cn?

MUST READ: The Last Lecture

I first heard of the book when I was traveling to a conference with a colleague who wanted to read the book, but wanted to find the best place to buy it. He briefly mentioned what the book was about, which I quickly forgot. I saw it again at several places, until I finally bought it from Strand bookshop in Bangalore. The most famous quote from the book is

“We cannot change the cards we are dealt, just how we play the hand.”
--Randy Pausch

This is one of the few books that I've had several people in my family read partially and love it (they are waiting to finish the full book). The book is about childhood dreams, how to achieve them and also goes a step further and talks about how to help others achieve their dreams.

The book is spectacularly well written, when you begin feel sad for Randy (the Author), there is a twist that will make you feel proud of the way Randy handled himself. The book is about positivity, about never giving up, about believing in humanity, in being true, about family values, about the good in the world, with sometimes what cannot be controlled and must be accepted.

Don't pick this book up as a pity book for Randy, you'll be left pitying yourself after reading everything that Randy did and how he lived his life, leaving us pondering if we've made the best use of our time. Randy focuses on family values, his students, his mentors, his family and there is not a single negative sentiment that he passes on to the readers.

If you are feeling depressed or need something good and small to read, something to boost your moral, to rebuild faith, to appreciate life and the people around you, you must read "The Last Lecture"

Dhoni's belief in Dravid

I like Dhoni's attitude, he said two important things

1. Demoting him will put pressure on him, since 3 or 4 wickets would have fallen when he comes in
   
2. He is a good player, who needs some time in the middle
   

That is again a sign of good captaincy. Dravid, wake up, shake up, cricket calls!

FOSS.IN (part 2)

In continuation from FOSS.IN (part I)


Photo by Sony Phil

The first keynote was from Harald Welte. The keynote was about embedded devices, manufacturers and proprietary Linux trees and their complete ignorance or lack of enthusiasm to contribute upstream. The presentation had information about how vendors were still using old obsolete Linux trees, which had several security flaws and the fixes were not being provided to users. The last keynote was from Kalyan Verma. Unlike the first keynote that lacked a single illustration, this one was full of award winning pictures, FOSS principles applied to other professions and life and also about the environment. How a cup of tea is playing its part in hurting the environment and the stress that we as humans and our requirements is putting on nature. Kalyan also spoke about his previous job as a security expert at Yahoo. He spoke about how cryptography makes no sense and there were obvious security flaws in most implementations. I disagree with Kalyan on some of the things he said about cryptography (like it makes no sense). I think what Kalyan was alluding to, but failed to say was that, security is only as good as the weakest link (a fact known to almost all programmers by now).

Kalyan mentioned that putting up his photographs under creative commons has gone a long way in helping his career. Since the pictures were free to download, they were shared under creative commons, which lead to newer opportunities and work. He went on to say, Pictures are a remarkable form of art. The more you look at them, the more you admire them, which is why sharing his pictures brought in more work and money.

Do check his photographs, they are really cool! James has a good coverage of his keynote as well.

The FOSS.IN team put out a video documentary covering their aspiration for their event and what was achieved. I'd say with FOSS.IN 2008, we've headed in the right direction, probably lost a few people along the way, but we are headed in the right direction. A technical event such as FOSS.IN should focus on contributions and try to encourage and build the mind share for it. Such a direction requires time and patience and also a lot of will power from both attendees and the organizers. We had a drastic change in sponsors this year, but we had them nevertheless, without whom such a large scale operation is hard to carry out.

The food, lunch and snacks were excellent, again James covered it well with photographs and other photographs marked foss.in on flickr. Here are some more memories from FOSS.IN 2008



Photo by Sony Phil


Photo by James Morris


From mdemon


From Sony Phil, photograph from the libcgroup workout

Lagrange's interpretation in python

I've been reading up on Fast Fourier Transform (FFT) from several books on algorithms that I have, TCLR, Tamassia, Sahni, Numerical Recipes, a big set of DSP books. Several of these books focus on interpolation before touching upon the subject of FFT. My favourite book so far for numerical algorithms is R.W. Hamming's Numerical Methods for Scientists and Engineers, Second Edition, Dover publication. Chapter 14, touches upon this topic. I love his explanation and illustration of interpolation versus extrapolation. Thinking along that subject, I decided to do some implementation of my own for interpolation. Sahni (Computer algorithms in C++) has an understandable implementation of the algorithm. The biggest drawback was implementing my own polynomial class. This is where, I think Python scores. I found that SciPy implements a polynomial class.

Here is the code for interpolation

def lagrange(x):
tmp = scipy.poly1d([0])
result=scipy.poly1d([0])

for i in x.keys():
 numerator=scipy.poly1d([1])
 denom = 1.0
 for j in x.keys():
  if (i != j):
   tmp = scipy.poly1d([1,-j])
   numerator = numerator * tmp
   denom = denom * (i - j)
 tmp = (numerator/denom) * x.get(i)
 result = result + tmp

return result

input = {0:5, 1:10, 2:21}
print lagrange(input)

NOTE: Blogger keeps messing up my indentation, I am yet to figure out why.

Sahni's input for the example is {0:1, 1:10, 2:21} and I was surprised to see my program return a different output. Fixing the input, showed the correct results. That reminds me, somebody please ask Sahni to start maintaining useful errata for his books. I searched on the web and found nothing useful.

Running the same algorithm on y = log(x) and input = {1:0, 2:0.3010, 3:0.4771, 4:0.6021}, gave me 00.0123 x^3 - 0.1362 x^2 + 0.6236 x - 0.4997, which corresponds to the cubical approximation of log x (R W Hamming, page 233).

FOSS.IN 2008 Report (Part I)

FOSS.IN was an event I usually attended, last year I co-presented and this year presented and held a workshop at. I've been meaning to display promotional content on my blog

But... I could not :(

Anyway, the story is not over, even though foss.in for 2008 is. The promos show clearly what the organizers had in mind. I must admit that the organizers make me nervous with the schedule, with selected talks being announced about three weeks before the final event, when I was on vacation. The schedule and slides can be found here. I presented on control groups and organized a workout for libcgroup. Both were well received with significant queries at the end of the talk and good workout participation. We got several patches posted during the workout and after. The workout plan and updates are here.

One of the things we did well this year, was the kernel hacker day at foss.in and followed it up with a successful workout. We had a good number of people come and talk to us about the kernel, their intention to contribute and the issues they face. We admittedly had a plan 9 fan, apart from Christoph Hellwig. There were lightening talks and I spoke about my ideas on building a threaded RB tree for Linux.

Kernel Hacker Gathering (Photo by James Morris as seen on flickr)

There are some fun photos, that several people took. Kushal from Fedora took some very nice ones. He was kind enough to photograph all women and leave me out. Needless to say Kushal, you owe me a T-shirt and I want it now! James Morris, did a good job of taking photographs as well.

(Photo by James Morris as seen on flickr)

(Photo by James Morris as seen on flickr)

One thing that did catch my attention was my T-Shirt with my name on it. I love the T-Shirt and hope it stops choking me, when I wear it, someday :)

Speaker T-Shirts (Thanks, well done guys!!)

I was caught working, I could show the code if needed!

You can find James' photo set here.

Lets step back, the event began with a video from team FOSS.IN

Atul has always been a good speaker, he began by explaining the motivation for the change this year and ate an Apple on the stage, claiming that it was only low hanging fruit in the conference and he ate it :) Unfortunately for Atul, we provided other low hanging fruits to developers and allowed people to contribute, even if the contribution was trivial. In the longer run, as foss.in proceeds year and year, I think we'll find the low hanging fruits disappear as the developers mature and our contributions mature.

I'll update on the keynotes, the other speakers and more interesting stuff in part II, stay tuned.

Having a bad day?

Have you ever had a feeling of a bad day. Days that you wish would either bring some good news or just end or if possible never started. We'll such days are definitely hidden in every month, every year and in our life. Believe it or not, one will strike it when you least expect it. One needs to learn to get through such days and even fight day. Fight back a day? Yes, it is possible

1. Be nice and assertive to the most annoying people around you
2. Don't show on your face that you are annoyed, wear a smile
3. Remember bad days can end quickly if you are positive and will last for ever if your attitude is negative
4. Learn from your bad days, analyze to see what you could have done differently to make them end faster
5. Help others around you have a good day, even if you are having a bad day (of course not at your own cost)
   

Fight back and take bad days away from your life. Remember life is too short to have bad days in them.

Bank of San Serriffe (with branches in Blefuscu and Elbonia on the planet Pincus)

Knuth has decided to stop sending personal checks, due to his discovery of a financial fiasco. I've have one hexadecimal dollar in the bank. The list of all people who have money in the bank can be found here.

Time out, take a break, Dravid!

(Photo from http://content-usa.cricinfo.com/indvaus2008/content/current/player/28114.html)

Dravid's dismal form continues in test cricket. He is already out of the one-day squad. When Dravid resigned as captain, he did so to focus on his batting. Unfortunately, Royal Challengers did not work for him (despite his good innings towards the end, when the challenge was already over). His test cricket form has also gone bad. I think it is time to hand Dravid the Ganguly treatment. Drop him from the squad and get him to make a comeback. This is the same thing he and Chappel did to Ganguly and it seemed to work well. I don't want to rule out Dravid for the future, but he seems to be holding up a place that he needs to deserve again. He has a lot of cricket left in him. Seeing his mates Ganguly and Anil must make him nervous, but he should look at Tendulkar for inspiration.

The best way to get back to form is to play domestic cricket and make a good comeback. I hope Dravid will realize that a break is in his favour and the selectors will hand him one.

The world economy, history and more

Looking through the great depression in the stock market reminds me of the 2001-2002 days, when the web commerce bubble burst and a recession was on our hands. Are we looking at a recession, we'll from my point of view and many others we are already in it; in fact we are in a worse state. I usually don't talk about the economy, but this time I am very worried

1. Look at India's IIP numbers
2. There is a liquidity crunch (banks are not even lending to each other)
3. Unlike last time, we are in a state where need a huge financial bail out

My brother sent an interesting SMS, which read something like

If my bank returns my cheque quoting "Lack of Funds" as the reason. I won't know if the funds were lacking in my account or in the bank

I do believe in the principle that "Money is hardly ever destroyed", why do I say that?

1. Wealth is usually created, as we find new resources, work harder, make new products or provide new services
2. In general money passes hands and is never destroyed
3. Wealth is sometimes destroyed, when we are hit by natural disasters that cause a loss in property, for example

Assuming that my principle holds, in the sub-prime crisis who made money? Where did the money change hands? Did the rich get richer and the poor get poorer? Did we boost our living standard to a higher standard than should have been?

In retrospective from the 2001 recession, web based commerce emerged back stronger and better. The technology, the pricing and the users matured (there were no more freebies for just signing up, BTW, I missed out on all of those :( ). What can expect to see as we come out of this recession? Will banks and insurance, investment companies be smarter? Will there be new regulations to make sure we don't hit such a crisis again?

Looking at the stock market, this is the third slump I've seen and been bitten by, the other two were

1. Harshad Mehta's stock scam (I was very small/young then, but I understood what was going on)
2. 2001 recession

History has taught me to be optimistic and know that we will come out of the bad times, the only thing to do is be patient, be positive and know that these things take a long time to recover, but they eventually do (or else we are doomed anyway, so what choice do I have, but to be optimistic :) ). Such times, test survival and like nature will choose the fittest to survive and learn from the mistakes of those who didn't survive the recession.

It is a cycle and we've hit the negative part of the cycle, the positives should be around somewhere, I hope we turn around quickly. Let's hope and pray that we quickly recover back from this situation and become stronger.

kernel summit 2008 photo on LWN.net

For those who have not seen it yet, it is at http://lwn.net/images/conf/lpc-ks-2008/ks-group.jpg

A thumbnail from LWN.net is included below. There were other photographers hired by Linux Foundation, waiting for them to post their photos and compare :)

Why I have not blogged in a while

Work and family life have kept me occupied. I just returned from OLS in July and I am currently at the airport lounge waiting to board my flight to Portland to attend the Kernel Summit. After the kernel summit, I go on to attend Plumbers Conference. I expect both events to be very exciting and it is a great opportunity for me to catch up with old friends around Portland.

I am not carrying a camera this time around, I intend to buy a good cheap camera, that can obsolete itself without making me worry about spending too much money on it. Conferences are usually a great time to get a lot of work done, lets see what this trip does to my productivity :)

Quote of the day

"Genius may have its limitations, but stupidity is not thus handicapped"

Elbert Hubbard

Fedora 9 and packaging

I ran into a weird issue with Fedora 9 today. Just before leaving home, I shut my laptop lid and headed out. In my auto rickshaw on Bangalore roads, I found my bag heating up. To my surprise, I found that the laptop failed to suspend. When I tried again, I saw a popup that said

Hibernate request refused, the package manager prevented the hibernate operation since it was in the middle on an uninterruptible operation or something similar. I had to manually kill all the packagekit processes and yum before I got the laptop to resume.

I should start filing the BUGS I find into bugzilla soon.

Upgraded to Fedora 9

I eventually took the plunge, upgraded to Fedora 9, the day it was released. What makes my desktop very interesting is that I have an "Nvidia" video card. I upgraded from Fedora Core 8 to Fedora 9. Notice the word core is gone in 9, that's because the core and extras repositories were merged in this release.

I often ask myself, why did I upgrade so quickly - as an after thought. The answer is that I like to try new stuff, I am excited by change, new features, the possibility of getting something better quickly. I think that's the open source philosophy as well "Release early, Release often"

The new features do come at a cost though. I had to spend a few hours trying to bring up my X. Nvidia is not supported as an in kernel driver, there is a proprietary driver for it. Here's what I tried

1. I used the VESA driver, but I was not happy about the missing graphics acceleration and open GL support
2. I tried the nvdia driver from livna, but that had other problems - including complaints about ABI not matching. I tried the trick of starting X with -ignoreABI and setting the option in xorg.conf
3. I wanted to try the driver directly from nvidia, but the kernel compile failed. I got patches from nvidia for 2.6.25 and ran into the same ABI issue. Ignoring ABI was not an option, since the shared library module for the nvidia driver uses a symbol that is now missing with the new X that comes bundled with Fedora 9

Disappointed, I went back to step 1 and I'll wait for the solution to come by or take a shot at a good solution myself. Downgrading X is not a good option, so I am going to hold on to that thought.

While configuring the X server, I remembered my first X install (Slackware, around 1999 or 2000). It came with a utility called xf86config, that asked a set of questions and generated a XFree86 configuration file, with a warning that getting the vertical and horizontal frequencies incorrect could fry the video card. Life is much better with Fedora 9, but not all that easy.

Although, I am beginning to like Fedora better than Ubuntu, Fedora's GUI package management sucks. Yumex is the closest thing it has for sane package management, the gnome based pirut, pacakgeit, etc all leave a user wondering what is going on in the background. I would highly recommend installing yumex and using it as the package manager

Fedora 9 comes with a bunch of kernel features - cgroups, cpu controller, cpu accounting controller and the namespace controller. I had a hand in some of these controllers, but unfortunately the memory controller has been disabled.

Fedora 9 comes bundled with FireFox 3 beta 5 (same as Ubuntu Hardy), FireFox 3 seems pretty cool in terms of user friendliness and stability. Downloading updates can be quite painful, unless you happen to know a very good and fast mirror. Most of the times I've tried to download updates, I get an error stating that the mirror is down or "no such file or directory" or "too many users". I guess that is expected since the whole Linux world is trying to get their hands on Fedora 9.

I found printing to be friendlier and more intuitive. I got errors correctly, stating that my printer was running low on ink or there was a paper jam. The print UI seemed quite robust and stable.

I tried KDE4, only to be a little disappointed. KDE4 on Fedora 9 is definitely much better than it is on kubuntu. Settings are well integrated and one has control over KDE4, unlike kubuntu where the controls are still for KDE3. The reason, I was disppointed with KDE was the interactiveness and latency in terms of response. The new UI is flashy, but most of my widgets failed to work (the comic widget and the dictionary widget, for example). The rendering of gtk based applications is quite poor. Most GUI on Linux seems to use the gtk widget library and some use Qt4. Firefox, eclipse, emacs, etc do not look very nice under KDE. These are still early days for KDE4, I hope it will mature soon into something I would want to use.

OpenOffice 2.4 was pleasantly surprising. As always, they seemed to have improved integration with documents and the generated pdf's look really nice. Usability is much nicer and so is the rendering and interactiveness. I would like to give them a thumbs up for this release. The major difference I saw with respect to Ubuntu's Hardy release was that there was no Sun Logo embedded in the splash screen of OpenOffice. I need to see why Hardy has the Sun Logo embedded.

I am glad to see (this was some time back as well) that Adobe and Google now have Fedora yum repositories, which is a very good sign. I wish nvidia would provide similar repositories.

I've just started using Fedora 9, I'll blog more on it, as I experiment and play with it.