Friday, July 24, 2015

FreeBSD 10.2-RC1 Now Available

The first RC build of the 10.2-RELEASE cycle is now available.

Installation images are available for the amd64, i386, ia64, powerpc, powerpc64, and sparc64 architectures.

FreeBSD/arm SD card images are available for the BEAGLEBONE, CUBOX-HUMMINGBOARD, GUMSTIX, RPI-B, PANDABOARD, and WANDBOARD kernels.

FreeBSD 10.2-RC1 is also available on several third-party hosting providers.

See the PGP-signed announcement email for installation image checksums and more information.

Friday, July 17, 2015

FreeBSD 10.2-BETA2 Now Available

The second BETA build of the 10.2-RELEASE cycle is now available.

Installation images are available for the amd64, i386, ia64, powerpc, powerpc64, and sparc64 architectures.

FreeBSD/arm SD card images are available for the BEAGLEBONE, CUBOX-HUMMINGBOARD, GUMSTIX, RPI-B, PANDABOARD, and WANDBOARD kernels.

FreeBSD 10.2-BETA2 is also available on several third-party hosting providers.

See the PGP-signed announcement email for installation image checksums and more information.

Saturday, July 11, 2015

FreeBSD 10.2-BETA1 Now Available

The first BETA build of the 10.2-RELEASE cycle is now available.

Installation images are available for the amd64, armv6, i386, ia64, powerpc, powerpc64, and sparc64 architectures.

Additionally, FreeBSD 10.2-BETA1 is available on several third-party hosting providers.

See the PGP-signed announcement email for installation image checksums and more information.

Wednesday, July 8, 2015

BSDCan 2015 Trip Report: Shonali Balakrishna

One of the slides at the opening session of the BSDCan conference read, “So many smart people in one room. This is why I attend BSD conferences.” I smiled to myself, and began to soak up the excitement of my first BSD conference. After nine talks and multiple conversations with the aforementioned smart people, I am thoroughly convinced! Not only does a BSD conference have way too many very smart people in one room, but also some of the nicest. You hear about the great work done by the FreeBSD community all the time, but not enough is said of the incredible FreeBSD community and the inspiration it provides.

I came in on 12th June, the first day of the scheduled talks, after a grueling finals week at grad school, and was very sleep deprived, but the excitement and the energy at the conference kept me wide awake. I found each of the nine talks I attended very interesting. It was incredible listening to THE Steven Bourne talk about the creation of the Bourne shell at the plenary, and his many insights and inside stories to do with it. I especially loved the part where he explained how he convinced Dennis Ritchie to inculcate the ‘void’ type into C and his candor about the debugging of shell scripts.

I especially enjoyed the following talks, among the ones I attended:

FreeBSD Operations at LimeLight Networks ­ Content Delivery Networks (CDN) are something that interests me, having had a research component on it at graduate school this year, and to see it in the operations perspective, with their usage of FreeBSD was very interesting. They deploy their own backbone and use FreeBSD on their backbone. For a big CDN, with many data centers, large scale installations of FreeBSD on the edge is an important factor. Such an operations workload requires fluidity in software and configuration changes and what is interesting is that only a handful of people are involved in the design and operations at Limelight Networks, as opposed to the usual model. The usage of FreeBSD allows both of these as you are pulled into the source tree and can get involved in the operations of the system. While deploying FreeBSD, their strategies involve upstreaming everything, using ports, and creating a src team. Tools used by Limelight were discussed, which I found informative ­ Zabbix for monitoring to ensure API driven configuration management, monitoring in test, dev and QA to form an efficient feedback loop, OpenTSDB for storing time series metrics, SaltStack for configuration management using a declarative style where the system takes action based on policy using an orchestration bus, Vagrant for pushing FreeBSD on the edge servers.

CloudABI by Ed Schouten ­ which is a Unix application binary interface which provides capability based security. It extends the concept of Capsicum, by providing a more compact representation with only about 60 system calls. This can be applied to cloud computing environments, instead of using full system virtualization or virtualized namespaces. CloudABI can be used in a far simpler way, with better performance, without complicated configurations, while providing security by controlling access to sockets, files and other resources. This was interesting to me, because it provides a whole new way of creating environments by building on capability based security to provide isolation and resource access control at the process level rather than complete isolation of environments to provide the level of security required.

An Introduction to the Implementation of ZFS by Kirk McKusick ­ This was an interesting talk for more reasons than the fact that it was Kirk McKusick himself talking about ZFS ­ there was also a fire alarm going off in the middle of the talk, followed by the arrival of fire trucks! I loved this talk for the clarity with which Dr. McKusick explained the ZFS block structure and checkpointing and made simple the rather complex concepts like freeing of filesystem and snapshot blocks in ZFS. The closing session hosted by Dan Langille was a lot of fun, and again the awesomeness of the BSD community was on shining display. I also attended the closing party at the nearby Lowertown Brewery, which was fun and a good opportunity for some networking as well.

Through this conference, it was great to finally meet Gavin Atkinson, who was the administrator for all of us GSOC students at FreeBSD last summer. I also got to converse with Diane Bruce, Ed Schouten, Deb Goodkin, Justin Gibbs, David Chisnall among others and every conversation was refreshingly unique in the perspectives it provided me with about the work done at FreeBSD, specific projects in FreeBSD, technology in general, the codebase, ways to contribute to FreeBSD, history, music and other myriad subjects. Ottawa was an incredible city to visit, and is so steeped in history and culture, and I soaked in the museums, art galleries and beautiful hiking trails it provided.

In terms of the work I’d like to do for FreeBSD in the future, besides wrapping up the testing of the BSNMP IPv6 project, I also learnt more about other projects I could potentially contribute to in the future, like further IPv6 support (userland cleanup, unification of ping and ping6, unification of traceroute and traceroute6), improvements to the Bluetooth module, 802.11 improvements and Space Communication Protocol, after exploring these with the people I spoke to. Even though I landed at Ottawa mentally exhausted, I returned completely excited and inspired, with many plans for future contributions to FreeBSD, and so very grateful to the FreeBSD Foundation for having provided me with this opportunity to attend my first (of many more, hopefully) BSDCan.

Shonali Balakrishna

BSDCan 2015 Trip Report: Kamil Czekirda

My trip to Ottawa, Canada was sponsored by The FreeBSD Foundation and took place in June 2015, where I attended FreeBSD devsummit and BSDCan 2015. I would like to thank FreeBSD Foundation for sponsoring my trip, Gavin Atkinson for an invitation to devsummit, and the mentor of my project, Warner Losh, for the meeting.

I arrived to Ottawa on Tuesday evening, I found the residence, checked in and dropped off my luggage. I had to look for a shop and do some shopping. It was too late for lounging about so I stayed for the rest of the day at the residence.

The first day of the Developer Summit / Tutorials for me started with “FreeBSD Storage for Sysadmin” tutorial by Michael W. Lucas. I experienced the jet lag, but it was stronger than I expected... During the brake I met Maciej Pasternacki from my country. Interestingly, Maciej was my neighbor on the plane from Montreal to Ottawa;) After the tutorial I joined the devsummit. My working group was “Designing Universal Configuration Files for FreeBSD” chaired by Allan Jude. There was a very interesting discussion about dividing system utilities for targets to USL­ify and not to ucl. I like the idea “show running config” for single compiled config for the entire system. In the end of the first devsummit / tutorial day we moved to the hacker lounge at the University residence, then during dinner I met Zbigniew Bodek, the third person from Poland at BSDCan.

On the second day of the Developer Summit / Tutorials for me started from the next tutorial about DNSSEC, unfortunately I missed Documentation and ARMv8 working groups, but I couldn’t be everywhere. After the Group Photo I joined the OpenZFS working group.

The main conference started on Friday. It was officially opened by Dan Langille, where Deb Goodkin told about the FreeBSD Foundation. The next step was an amazing keynote by Stephen Bourne about the history of Unix and /bin/sh. After the keynote we finished the devsummit track. Then I attended the Public track, where Kylie Lang explained why Microsoft loves FreeBSD and then Warren Block criticized the installers. The last subject was especially interesting for me, because I worked on installers last summer. During the break I was talking with Warren about profiles for installers. The next talk I've seen, was a legendary “A reimplementation of NetBSD using a MicroKernel” by Andy Tanenbaum, I heard very positive opinions about this talk on Sofia last year.

The lunch break was very productive, except the lunch itself, of course. I found Kris Moore and told him about my patch for freebsd­update. He directed me to Colin Percival and finally with Allan Jude and Nathan Whitehorn supported Xin Li who closed bug 194746 in FreeBSD Bugzilla.

Then there was George Neville-­Neil's talk about measuring network performance. After this talk people tried a cake brought by The FreeBSD Foundation, they were celebrating 15th birthday. Other talks I've seen were from the System Administration track, where Joseph Mingrone explained how scientist use FreeBSD in computation.

And the last one of that day ­ the Olivier Cochard­-LabbĂ©’s talk entitled “Large­ Scale Plug & Play x86 Network Appliance Deployment Over Internet” ­ was one of the most interesting ones for me. There was another event of the day ­ after dinner in the hacker lounge I had a meeting with the mentor of my GSoC project – Warner Losh.

The last day of the conference for me started with the second George Neville-­Neil's presentation about teaching advanced operating systems. I’m a student and it was very interesting how they do it in Cambridge. The next talk was given by Randi Harper about fighting harassment with open source tools. We really need more non­-tech talks on conferences.

After lunch I attended the Daichi Goto’s talk: “FreeBSD for High Density Servers”. Daichi told how people from NEC install thousands of FreeBSD by PXE. The last two talks were about virtualization, the first given by Michael Dexter briefly described virtualization possibilities in FreeBSD, and the other presented by Maciej Pasternacki showed a lightweight virtualization technique based on FreeBSD jails and ZFS. During his talk we had a building evacuation, after which Maciej finished his talk about Jetpack.

I was really surprised by the charity auction that took place in the time of closing session, where Dan gave a great show. I had a great time during the closing party in a brewery in the Market, I’ve tried bacon in maple sauce for the first time.

The last point of the schedule was the Tourist Day, which we started at 10.00 AM, I’ve never seen Ottawa before, so I really enjoyed this short, but very interesting trip. We finished at about 2.00 PM and after dinner I came back and rented a bike for one more trip.

I think that attending the conferences like those is a huge motivation for work for new people. It was a great opportunity to meet people whom I had known only from the Internet. I hope I will be able to participate in devsummits and BSD conferences again in the future.

Kamil Czekirda

Tuesday, July 7, 2015

BSDCan 2015 Trip Report: Christian Brueffer

For several years now, BSDCan has been known in the FreeBSD universe as the place to be. It features great talks, is attended by many people FreeBSD core developers, some who usually don't make it over to one of the European conferences, as well as the largest FreeBSD developer summit.  In 2010 I was lucky to have the FreeBSD Foundation sponsor my trip to BSDCan.  This year I was fortunate to have the Foundation sponsor my trip again.

I arrived in Canada some time before the conference to see a bit of the country, and to shed any sign of jetlag before the start of the developer summit (a lesson I learned from my previous BSDCan trip).  At the "Goat BoF" the day before the start of the developer summit I met many familiar faces, and was able to meet some people I knew by name but had never met in person before.

The next day was marked the start of the devsummit.  It's hard to find a better place to get things done than in this inspiring atmosphere, single-mindedly focused on FreeBSD. Uninterrupted FreeBSD time is something I usually lack, so I managed to make a progress on a few of my long-standing TODO items, most notably the export of the OpenBSM repository from the FreeBSD Perforce server to git.  The issues this presented on previous attempts were still there, but this time I was able to get it done and, after some more work after the conference, the repository has finally moved to GitHub.  Another thing I explored was using BHyVe as a provider for Vagrant, a popular tool for creating reproducible development environments.

On the second day of the summit, I participated in the documentation working group.  It was great to finally meet some of the most active people in the last few years.  We had a productive day with Warren Block as ring leader, discussing topics ranging from translation, over the doc toolchain, to manpages.  A special treat was the presence of Ingo Schwarze from the OpenBSD project and maintainer of the mandoc package, as well as Ryan Lortie from GNOME. Having outside experiences definitely benefited the discussion.  One of my goals was discussing moving the release documentation from the source repository to the doc repository, to allow us to make corrections after a release.  It was a good discussion, and Hiroki Sato explained some issues I had not considered beforehand.

The conference itself was a fantastic.  It does not happen every day that you have people like Stephen Bourne, Andrew Tanenbaum and Kirk McKusick under the same roof.  There were many great talks, however the most interesting one for me was "Molecular Evolution, Genomic Analysis and FreeBSD", given by Joseph Mingrone.  I'm a graduate student in cancer genomics (the analysis of genetic data from cancer patients), which is a closely related field with many of the same issues and tools.  Biological and medical research is dominated by Linux, with the problem that scientific researchers usually don't write the best and most portable code.  This makes it more difficult to use FreeBSD, as oftentimes one wants to try out software from the latest research paper. Combined with the fact that biological/medical datasets are oftentimes huge, performance really matters, ruling out virtualization.  As it turns out, Joseph had the same experience but found that bhyve appears to have low enough overhead to make this feasible.  My hope is that we can work together to make FreeBSD a better platform for this kind of research.

In the evenings, I spent time in the hacker and doc lounges where the discussions and the work continued.

All in all, the conference and the devsummit were a great success for me.  I learned a lot, and it's always astonishing how seeing the cool stuff other people have been working on motivates me to work on FreeBSD better myself.  Thank you to the FreeBSD Foundation for making this trip possible!

Christian Brueffer

BSDCan 2015 Trip Report: Warren Block

BSDCan 2015

By Warren Block: wblock@FreeBSD.org

BSDCan, the large BSD conference in Ottawa, Ontario, was held in June this year.  Each year, it becomes a bigger event.  As in previous years, Andrew Ross was there with the FOSSLC Project, recording the presentations with excellent video and audio quality.  As of this writing, some but not all of the recordings have made it to YouTube, and links are included for the ones that are known.

Developer Summit
A FreeBSD developer summit is usually held in the two days prior to the conference itself.  The summit gives developers a chance to plan projects and present ideas to other developers in person.

I was lucky enough to give the documentation working group's presentation.  There is always concern about whether enough people will be interested in any given topic to make the meeting worthwhile.  That turned out not only not to be a problem, but we actually had extra people show up.  Better yet, they were all enthusiastic and interested.

We talked about revamping our translation system and tuning the documentation toolchain, possibly asking for help from the Foundation to do that.

Another major point was encouraging people to contribute to the documentation, and lowering the barriers to make such contributions easier.  Live demonstrations are the computer equivalent of "Hold my beer and watch this!", yet I managed to show how Annotator (http://annotatorjs.org/) could be used to let people review and comment on our documents without having to know any of the complex markup languages.  Help is still needed with porting a Storage component for this, please contact me if you are interested.

The FreeBSD wiki is underused, and we talked about ways to allow more people to contribute there without lowering our standards of quality.  I actually forgot to mention my idea about that, where new wiki contributions would automatically generate reviews at https://reviews.freebsd.org/.  Either a special group of wiki reviewers or any committer could approve them, spreading the load.

Another big issue was the FreeBSD.org website.  Almost everyone agrees it needs to be updated.  Where they disagree is the is the issue of how. The Foundation has updated their site recently, and might offer help with ours.

We had a total of three hours for the documentation working group, used all of it, and could have used more.

Doc Lounge
On nights after the developer summit and BSDCan, the FreeBSD documentation group holds an informal session where people can gather and learn about or work on documentation.  We usually have a few short presentations and try to provide one-on-one time for attendees to talk with documentation committers.  The trick is trying to work with all the people who show up.  The doc committers are usually outnumbered, but people are always incredibly patient.

Presentations
Only a few of the talks will be highlighted here, but go watch all of them online.  Really.

The keynote presentation was Stephen Bourne's excellent talk on sh.  It gave an inside view of software design within the limitations of available hardware.  Along with that were some insights on things that might have been done differently in hindsight, or not at all.

The opening session ran somewhat long, and there was some confusion on schedules for the rest of the day.  I gave a second presentation, called "Thinking About Installers: Discord and Happiness" about how a different view of installers could make the job of installing FreeBSD much easier, regardless of the amount of customization needed on the target system.  Despite the schedule confusion and this talk not even being listed by name on the program, it was surprisingly well-attended. Some of that was certainly due to Kylie Lang's preceding talk about FreeBSD on Hyper-V and Azure.  Still, the attendees were interested, asked good questions, and offered suggestions.

In the afternoon, Ryan Lortie of the Gnome project talked about jhbuild. Gnome has recently included FreeBSD as a supported platform, and this is their method of continuous testing and building.  Initially met with not much interest, the interaction and cooperation has grown and benefitted both projects.

Later in the afternoon, Joseph Mingrone showed the use of FreeBSD clusters for genomic analysis. The application of clusters to this high-end scientific project was interesting, and combining it with down-to-earth sysadmin problems made for a unique presentation.

On the second day of talks, Kris Moore talked about shifting the PC-BSD management utilities to web applications.  That was interesting, but then it got even more interesting when he described background updates, which make it possible to upgrade a machine transparently while in use. This builds on the concept of ZFS boot environments, and has serious advantages for end-user desktop systems.

Baptiste Daroussin gave a fascinating talk about packaging the base system.  This will be a big step forward in being able to install and customize FreeBSD systems quickly and easily. People have been concerned about how this change might affect users, but the audience was very receptive and the talk anticipated and answered those concerns. One of my former mentors, FreeBSD Release Engineer Glen Barber, even spoke one short sentence into a microphone, probably breaking his previous record.

Later that day, Sevan Janiyan (who we met last year at the doc lounge) had a very interesting talk about building pkgsrc applications in unusual environments.  pkgsrc is NetBSD's equivalent to ports, and he took that tree and attempted to just get it to build on numerous Unix variants and architectures.  Even just trying to build the tree without succeeding caught bugs, often serious ones in the host systems.  And that was from just trying to build the tree, not get the applications to run afterwards.  Several of the talks this year pointed out how revealing testing could be, even trivial testing.  Testing is good.  We need more of it.

During this talk, we had our second schedule confusion.  A fire alarm went off, and we had to evacuate the build for a short break.  It turned out that someone had overheated something in a microwave on one of the higher floors (my guess is microwave popcorn, the bane of office workers everywhere).  After the fire department left, we resumed the talks.

The closing talks and charity auction were somewhat rushed, but still great. The closing party at the nearby Lowertown Brewery was excellent. These informal events are great for meeting people that were only known by their email addresses previously.

The FreeBSD Foundation
The Foundation always has a table set up during BSDCan.  They are too shy and polite to collar people walking by and ask them to help support FreeBSD with a donation.  Unless you go to one of their talks, you might not even know that individual contributors are needed to show the auditors that the Foundation is community-supported, and even small donations increase the contributor count.  If you see them at a conference, stop and talk to them.  Make a small donation, or a large one if you prefer.  Many FreeBSD improvements have been possible solely because of the Foundation's support.  They continue to grow by adding good people.  This year, they announced that Benedict Reuschling, my other mentor, has joined the board.

Conclusion
BSDCan is not what most people expect.  It is not a boring computer conference.  Sure, there are presentations and talks and the standard conference stuff.  But this is a place where BSD nerds are the norm, not the exception; where the other people there speak your language, share and understand your problems, and know that you understand theirs.  It is a feeling of family, a chance to share and solve problems, and gather inspiration for the rest of the year.

Thanks
My thanks to the FreeBSD Foundation for making it possible to attend BSDCan, to Dan Langille for creating and running BSDCan, and to Dru Lavigne for always being there.