Links everywhere this week!
Another week where I barely need to look up source code commits.
The DragonFly Mail Agent is being suggested as a possible sendmail replacement for FreeBSD.
Read the first item, if nothing else.
I was remiss in not posting this before it happened, but Issac (.ike) Levy of NYCBUG went to Tokyo to talk about the translation efforts for pfSense, on the 17th. He posted a summary of his talk and slides.
Normally I would be posting this in an “In Other BSDs” Saturday item, but the summary page includes links on Open Network Hardware, which .ike and I talked about at NYCBSDCon. I wanted to create a separate post for it, but he’s got all the links piled in with his talk summary already.
The hardware I want to see as a real product is the Intel ONP Switch Reference Design. (PDF) Having a device that looks like a switch but is actually a normal computer with a lot of network ports – that can run BSD – opens up a huge range of network possibilities.
Lots of links, yet again.
As you read this, I’m at NYCBSDCon – or at least should be.
- FOSDEM 2014 videos are up. The second item listed is about the new version of ports, which includes dports. (via)
- Crochet-FreeBSD, a system for building bootable FreeBSD images for a variety of platforms including x86, ARM, and VM. (via Markus Pfieffer on IRC, indirectly)
- Effective Spam and Malware Countermeasures. Seen previously at BSDCan. ’Greytrapping’, mentioned in the article, is new to me.
- Email delivery headaches. Mailing many people is somehow almost always a low-level irritation.
- DiscoverBSD’s 2014/02/03 roundup.
- Another n2k14 hackathon report. DragonFly uses that DHCP client he’s talking about.
- PC-BSD on eWeek.
- bsd-cloudinit – FreeBSD on OpenStack. (via)
- OpenBSD gained some VAX hardware. The only VAX hardware I ever saw was 6 feet tall; I can’t imagine these are easy to ship.
- OpenBSD updated to ldns 1.6.17.
- Seen via a pkgsrc list: Berlios.de is closing down its hosting, so this may affect you if you usually grab your pkgsrc packages from there.
- The proper way to break the FreeBSD ABI.
- Robert Watson’s privilege ideas.
- How to switch between mfi(4) and mrsas(4) on FreeBSD. mrsas(4) sounds like MRSA to me, which is a bit more worrisome
- FreeBSD supports MegaRAID Fury cards.
- The plan for ATF removal in NetBSD.
- DragonFly takes the FreeBSD patch(1) updates, and that’s fine, because FreeBSD made those changes to an import of DragonFly’s patch(1). Hooray for cross-pollination!
For once, I got this mostly done before late Friday night!
Back to relatively normal volume, this week.
- FreeBSD 10 is out.
- OpenBSD got electrical funding, and is now holding a funding drive.
- new openssh key format and bcrypt pbkdf. A new key format for OpenSSH, and how to switch to it – only available in OpenBSD as of this writing.
- I did not know this: There’s a pfSense store, with shirts, preloaded USB sticks, and various appliances – I have one of the Netgate FW-7541 models, notable in that I’ve never had to do anything with it after initial setup; it just runs and runs. There’s a pfSense hangout/webcast for paid support customers this Friday the 24th, too.
- Open Source FreeBSD 10 Takes on Virtualization. From a saved Google search.
- Undeadly has an explanation of the new signed packages setup for OpenBSD.
- DiscoverBSD’s 2014/01/14 roundup.
- FreeBSD now has OpenSSL 1.0.1f.
- NetBSD now has a wscons/Intel GMA driver.
- PC-BSD 10 is almost out, and here’s their weekly digest talking about it. Also, apparently PC-BSd and GhostBSD share some installer code? I’m not clear on this.
- CBSD – FreeBSD jail management. (via)
- Slides and audio from Brian Callahan’s recent OpenBSD presentation at NYCBUG are up.
- OpenBSD has a qla(4) driver, for Qlogic fiber channel HBAs, and ubcmtp(4), a Macbook touchpad driver.
I didn’t even need to find source links this week.
Running late putting this together… Back to bullets!
Things are picking up again after the break.
- Faces of FreeBSD: Isabell Long. Note that she came in via Google Code-In. That’s the value of those programs.
- OpenBSD: Randomness, sooner.
- OpenBSD’s change to PIE for i386 means special upgrade procedures – if you’re on i386. Also, here’s PIE. atexit(3) changes also changes the upgrade method this one time for… all platforms? I’m not sure.
- The DiscoverBSD roundup for 12/31/2013.
- The FreeBSD Test Suite. It’s similar to what NetBSD has, but see the source link for comments on what’s different. DragonFly has a test setup too, though I’ve never tried it – is there one for OpenBSD?
- Pkgsrc-2013Q4 is branched.
- FreeBSD has improved NFS performance.
- NetBSD has updated libpcap, tcpdump, wpa, bind, and dhcpcd.
- OpenBSD has updated xterm, glproto, and some other xenocara parts.
Again, quiet from the holiday break.
Another week where I could get away without any commit links, just cause there’s so much BSD stuff out there.
The bnx(4) and bge(4) network drivers now have APE support, thanks to Sepherosa Ziehau. What’s that mean? Other than an opportunity for punning jokes, I don’t know.
I had a sometimes-great, sometimes-difficult trip to New York City over the past few days, and while I was there, I met the ball of energy that is George Rosamond of NYCBUG (which is having a huge party right now.) He and I talked for a bit about various aspects of the BSD ecosystem, and one thing he noted was that people aren’t generally aware of all the licenses in use for the different software packages on the system, or even the individual licenses in the system files.
There is an ACCEPTABLE_LICENSES setting in pkgsrc, where software licensed under terms not in that list won’t install. That’s useful, but frustrating, because it keeps people from getting what they asked for – a software install. Something that would be useful – and it could be cross-BSD very easily – would be a license audit summary.
There’s meta-data on every package in FreeBSD’s ports and DragonFly’s dports and pkgsrc and OpenBSD’s port system. Why not say ‘pkg licenses’ in the same way you can say ‘pkg info’, and get a summary of the licenses you have installed in the system? (or pkg_licenses, etc. You get the idea) This wouldn’t prevent people from installing software, but it would give a very quick view of what you were using.
> pkg licenses
Software package License
foo-2.2.26 Apache license
It could be extended to the base system, but I’d like to see this in all the packaging systems as a common idea, in the same way that ‘info’ in a packaging command always shows what’s installed.
A lighter week for commits probably because of the U.S. holiday, but still plenty of things to link.
If you have a recent laptop with an iwn(4) wireless chipset, Matthew Dillon’s recent work getting an updated version of the driver together will probably help you. It was done specifically to support a Intel Centrino Wireless-N 2230, but many more should also now work.
I’m working my way up to more than just links to source for the cross-BSD news. There’s a lot to swim through!
- NYCBSDCon 2014 (on February 8, 2014 - note the recent change) is, in addition to the normal call for papers, having a ‘call for exposés’, meaning they want people to expose BSD projects. I found this out through the undeadly.org description noting that some MIPS machines will be on display. This is an excellent idea; BSD projects need a showcase.
- There’s also a NYC Tech Meta-party, with NYCBUG and many other groups participating.
- FOSDEM 2014 will have a BSD Room.
- FreeBSD developer and FreeBSD-based-business-owner Colin Percival gets a spotlight from the FreeBSD Foundation.
- DiscoverBSD’s BSD summary. We need more of this.
- FreeBSD News miscellaneous links. Hey, there’s more!
- hostileadmin has a slew of wrap-up reports from vBSDCon. Sounds like a good time was had by all.
- Here’s more vBSDCon wrapups, plus slides.
- And a developer (John-Mark Gurney) trip to vBSDCon sponsored by the FreeBSD Foundation.
- Also, AsiaBSDCon OpenBSD presentations in video form.
- The pfSense blog is called “The pfSense Digest”. Digest… hey, that sounds like a good, descriptive term! They also are looking to hire. I just used some of my paid pfSense support time on a work problem – well worth the money spent.
- OK, back to source commit links.
- FreeBSD has enabled some Texas Instruments hardware.
- FreeBSD has added some example test framework programs.
- FreeBSD has added the axge(4) driver for ASIX AX88178A and AX88179 USB Ethernet
- OpenBSD has 802.11A support in wpi(4).
- (updated to add) There’s a PC-BSD weekly digest, too. That’s good, because I had trouble spotting things in the massive flood of PBI approvals over the past week.
Not as much pulled directly from the source lists this time, which is good.
Not sure why, but there wasn’t a lot of things this week to pick out.
There’s a surprisingly large list this week.
- FreeBSD has updated netmap.
- FreeBSD supports VT-d DMAR hardware. Not totally sure what that is.
- FreeBSD supports the RealTek RTL8168G, RTL8168GU, RTL8411B, and RTL8168EP.
- FreeBSD updated byacc to version 20130925.
- FreeBSD has binary packages again.
- Managed Services using FreeBSD at NYI, a whitepaper.
- NetBSD has imported OpenBSD’s support for ASIX AX88178a and AX88179 USB network interfaces, in the axen(4) driver.
- NetBSD supports the Broadcom BCM56340 iProc based switch.
- OpenBSD supports unattended installation. See Also on Undeadly.
- OpenBSD has softraid booting documentation. Someone will find this useful, I’m sure.
- OpenBSD 5.4 is released.
- Inspecting Packets with OpenBSD and pf, the presentation from vBSDCon.
- Lua in pkgsrc has been modified.
- Ocaml in pkgsrc has been updated to 4.0.1.
- The BSD Router Project has hit 1.5. (via)
- PC-BSD 10 alpha images are available for testing.
- PC-BSD is doing weekly updates, an idea I support, unsurprisingly.
- No BSD systems in Google Code-In this year, darnit.
Joris Giovannangeli, who worked on porting Capsicum to DragonFly for Summer of Code 2013, is continuing his work. He’s posted a detailed note on how to do capability management in a new way, with it retaining compatibility with FreeBSD’s capsicum implementation.
Once again, doing this at the last minute:
I am doing this one at the last minute. I had all the articles noted, but normally I build this post over the course of the week.
I got some PC-BSD items this week, too.
The Radeon KMS driver from FreeBSD has been imported to DragonFly by Francois Tigeot. It still has problems with ttm, but don’t let that stop you from taking advantage of it.
Franco Fichtner recently received commit rights for DragonFly. This is so he could import mdocml, a OpenBSD-originating replacement for groff and man page display. Mdocml has been mentioned before on the Digest, and there’s a downloadable book. (See the more-interesting-than-it-sounds History of UNIX Manpages there too, but I digress.)
One advantage of using mdocml, as I understand it, is that groff is no longer required to view man pages. The only thing left in DragonFly that required a C++ compiler was groff. So, rebuilding could be a bit faster, and a bit less complicated.
Here’s the part that makes me happy: Changes made in DragonFly promptly made it back into NetBSD’s mdocml. Other changes rolled from DragonFly back into OpenBSD, too, and mdocml is in FreeBSD 10, though I don’t have a src change to point at right now. It all circled back around to DragonFly, too. It’s really neat to have a BSD-grown cross-BSD product.
(Incidentally, if you have a Thinkpad and keyboard issues, Franco has a patch for you to try.)
Less straight source links this week.
Related to DragonFly: Patrick Welche updated glib2 in pkgsrc, and is interested in hearing how it works for DragonFly users. If you have pkgsrc on your system and it’s not a quarterly release, try building t.
This week was relatively quiet, but also had the most cross-BSD work I’ve seen in a while. Look at the links and you’ll see.
Here’s more on Unbound, since it seems to be a trend.
Barely getting this done in time for Saturday…
There’s been a lot of commit activity across the BSDs, but my list doesn’t seem to reflect that. A lot of incremental work, I suppose.
I need to update this post during the week as I see stuff, or else I spend an hour rushing to get it all together before Satuday. I need to start watching PC-BSD src changes, too.
Sascha Wildner has ported rum(4), run(4), and urtwn(4) from FreeBSD to DragonFly, to work within the not-yet-default new USB framework. This happened some days ago, but I’m just now catching up.
I hope I’m catching the interesting stuff; I’m only reading the src changes.
Michael W. Lucas has a short article up about sysrc, a FreeBSD tool for handling rc.conf across multiple machines. This could easily be a cross-BSD tool – hint, hint.
Update: as Sascha Wildner pointed out, rcrun covers that in DragonFly. Mostly I’d like to see the same interface, then, I guess?
Definitely Saturdays for this summary. In other BSDs this week:
Francois Tigeot has ported TTM to DragonFly from FreeBSD and I think a bit from OpenBSD. All this work has led to an update in the driver porting notes.
Michael W. Lucas wrote a blog post about pkgng and Ansible on FreeBSD. Will it work on DragonFly? We already have pkgng on DragonFly in the form of dports, and Ansible… might work? Please, someone try.
Here’s what jumped out at me from reading source change mailing lists:
I’m going to have to set a specific day of the week aside for these.
Do you have a Emulex OneConnect 10Gb NIC? Well good news! Sascha Wildner
brought in updated the oce(4) driver from FreeBSD to support Skyhawk models in DragonFly.
(My bad; looked at the wrong oce(4) commit originally and re-reported the import instead of the update.)
I made a hesitant attempt to keep an eye on other BSD source changes over the last week. I complain about needing coverage for the other BSDs, so I’ll see what I can do:
Supposedly it’s FreeBSD 9.0 under the hood on the new Playstation 4 systems. What does this mean for FreeBSD, or driver support, or BSD in general, or what you can run on that hardware? Possibly nothing other than a vague sense of superiority.
On the other hand, this BoingBoing article makes a good point about commodity hardware and its immediate utility. It’s an effective network storage device and it doesn’t even mention FreeNAS.
Michael W. Lucas has two bits of mostly-BSD-centric publishing news. One is that a physical version of his DNSSEC Mastery book is now available through Amazon.
The other bit is that, having just released an Absolute OpenBSD update, his Absolute FreeBSD book will not see an update… until the FreeBSD installer gets more coherent.
(If you manage DNS in any fashion, buy DNSSEC Mastery.)
I think spring has arrived; everything’s turning green, and a young man’s thoughts turn to computer hardware upgrades. Time to move to 64-bit! Anyway, lots of links this week. These are getting more and more content-filled over time, but I don’t think anyone minds…
- For the Bitcoin enthusasts: ‘…when my wife refuses to bring him cake on our sofa, he calls it a “denial-of-service attack”’ (via)
- Make It So, coverage of computer interfaces from movies. I always thought that was what Enlightenment was trying to achieve: the Interface From The Future. (via several places)
- Same computer interface topic, but from anime movies. It would be nice if this became something people actively worked on, instead of Bitcoin selling and Facebook monetizing. (via)
- Flat icons/monochromatic icons seem to be another microtrend. This is probably because few people do small dimensional icons well. My favorite was always the BeOS set.
- On benchmarks. It says what you should already know, but I like the Phoronix/MD5 benchmarking joke. (via EFNet #dragonflybsd)
- This article titled “The Meme Hustler” draws a finer line than I’ve seen before between “open source” and “free software”. The author, Evgeny Morozov, seems to also have a hate-on for Tim O’Reilly. See some reviews of a recent Morozov book for a counterpoint, of sorts.
- Spacewar championship, 1972, in Rolling Stone. Exactly two years before I was born! At this point, finding things older than me makes me a bit happy. There’s a picture of a Dynabook in there, photographed by Annie Liebowitz. It’s entertaining to read this 40-year-old story and see how well it predicts the future. I’m also sort of amazed it exists, in Rolling Stone. More Spacewar links here.
- Meet the Web’s Operating System: HTTP. ”Because HTTP is ultimately the one social contract on the web that, amidst a million other debates over standards, rules, policies, and behavior, we have collectively agreed to trust.” (via)
- Ancient computers in use today. I’ve linked to a story about that IBM 402 before, but the following pages about VAX and Apple ][e systems are new. Well, new to read, certainly not new hardware. (via)
- Yahoo Chat! A Eulogy. The spray of forbidden words is an entertaining acknowledgement message. (via)
- The $12 Gongkai Phone. Bunnie Huang breakdowns are always fun, and he’s describing a strange sort of open source that isn’t through license. (via)
- The FreeBSD Foundation is looking to hit a million dollars donated this year, which seems quite possible given last year’s performance. Donate if you can; their activities help the whole BSD community.
- A Complete History of Breakout. It’s not actually complete, but that’s OK. It includes Steve Jobs being a jerk and Steve Wozniak being very clever, which is their traditional roles. (via)
- Ack 2.0 is out. It’s a very useful utility; I’d like to see more standalone utilities created this way.
- Space Claw, Flickr via BBS. You’ll need telnet. (via)
Your unrelated link of the week: Shady Characters, a typography/history blog I’ve linked to before, has a book out. If you liked those links, you know what to do next.
If you have a mfi(4) device – in other words, a LSI MegaRAID SAS driver – you can now see/import/clear/etc. foreign configurations, thanks to this commit from Sascha Wildner, tested by Francois Tigeot, and originally from FreeBSD.
For the confused, ‘foreign’ means any disk hooked to a RAID controller that isn’t part of a configuration the RAID device already knows about. A replacement disk, or more worryingly, a good disk gone bad/unrecognizable. (I’ve had both.)
Peter Avalos has committed another batch of updates to sh(1), from FreeBSD. I was going to comment on how strange it was to see software getting updated so many years later; you’d think everything there was to update for /bin/sh had been done at this point. Digging casually, the oldest bit on sh that I can find is from 1991 – 22 years old. The man page mentions a rewrite in 1989 based on System V Release 4 UNIX, and there were versions of sh all the way back to version 1.
Here’s a trivia question – what’s the oldest Unix utility, and what’s the oldest code still in use? I don’t know the answer.
I wasn’t aware of this, but apparently DragonFly’s version of patch(1) comes from OpenBSD and NetBSD. FreeBSD’s old version of patch is being replaced by this and modified to match the old one’s behaviors. It would be worthwhile to bring these changes back, if possible, just to reduce the differences in a utility that’s already been around the world, so to speak.
As an aside, I always thought patch was one of Larry Wall’s unsung successes, and I’m entertained by any program that has “Hmm…” as one of its official outputs.
For once, I got to read the commit logs for other BSDs…
The OpenBSD ‘Papers’ page has some videos listed to match the OpenBSD-related presentations from EuroBSDCon 2012.
Not only does NetBSD support the BeagleBoard, but Michael Lorenz is committing from it.
FreeBSD has brought in a new version of bmake and jemalloc. I’ve seen a number of other commits recently attributed to ‘NetApp’, which is good to see. Also, preliminary USB support for boot loaders.
PC-BSD is looking to use pkgng, the same binary package manager used in John Marino’s DPorts. It’s proving quite popular.
Venkatesh Srinivas and Tim Bisson have been working for some time on a port of FreeBSD’s virtio and virtio-block drivers. (see man page commit) They’ve now been committed. This should make your virtual disk perform better, if nothing else.
The last of the year.
Your unrelated comics link of the week: Marlo Meekins’ Tumblr. Her lettering is refreshingly expressive. That may sounds strange to single out, but so many people place words as an set block of text rather than as part of a graphic layout.
It’s the end of the year, so it’s time for the FreeBSD Foundation’s end of year campaign.
This discussion of cryptographic hardware for FreeBSD may include hardware that would work for DragonFly too. Can someone verify?
Sascha Wildner recently brought in support from FreeBSD for HighPoint’s RocketRAID 4520 and 4522 SAS/SATA RAID cards. It’s in the hptiop(4) driver.
Sascha Wildner has added system management BIOS (SMBIOS) support, visible with kenv, from FreeBSD. Use it for getting things like the BIOS revision, system manufacturer, and so on. For example:
smbios.bios.vendor="Dell Inc. "
This may seem minor, but this can be very helpful when dealing with hardware you aren’t physically able to access.
Today is the day that FreeBSD moves to using clang by default. This is not necessarily a surprise, but I like the finality of calling it “Clang-Day”. I think Clang will probably be the next compiler brought into DragonFly’s base system, instead of the next release of gcc. Don’t make any bets on my statement, though, cause I certainly won’t be the one doing it. (It’s hard.)
John Marino is working on a very good idea: bringing bmake into DragonFly as a replacement for the current ‘make’. bmake is going through more active development and apparently also in use/will be used? on FreeBSD, so syncing up with the same make flavor as FreeBSD and NetBSD will help everyone. It’ll also remove the problem where you ‘make’ everything in DragonFly, except pkgsrc packages which you ‘bmake’. It’s not changed over yet.
(What does OpenBSD use for make?)
Sascha Wildner has committed Markus Pfeiffer’s port of USB4BSD to DragonFly. USB network, input , audio, and storage devices (including xhci/USB3 items) may work, though there’s no guarantee for each driver. This is added but not on by default, so see the first link for instructions on how to rebuild your kernel to use it. This will be in (but not default) the DragonFly 3.2 release.
(This is shaping up to be a much bigger release than I anticipated!)
Sascha Wildner’s added updatesfrom FreeBSD for the Areca arcmsr(4) driver; specifically for the ARC-1213, ARC-1223 and ARC-1882 models.
NYCBUG, the NY BSD user’s group, has an RSS feed for their speaker events, found via Dru Lavigne’s always useful BSD Events twitter. The next event at the start of October is a talk about SMPng in FreeBSD. Given that it was the project that in part led to the creation of DragonFly, I’d like to hear about it. (and even better, have someone more qualified than I compare and contrast that approach with what’s in DragonFly.)
This recent question asked on-list about creating your own file system meandered into good reference books. This so far was “The Design and Implementation of the FreeBSD Operating System“, “Modern Operating Systems“, and the paper “Vnodes: An Architecture for Multiple File System Types in Sun UNIX“. Looking for links on those things led me to this Unix filesystem history paper from IBM, which is fun reading.
I’m saying that unironically! It really is an interesting document to read, for historical and general knowledge. I am a nerd.
Adrian Chadd has apparently been smushing FreeBSD onto MIPS systems for some time, and he’s going to talk about it tomorrow night at the NYCBUG meeting. I’m noting it because I’ve always found it interesting how much can be stripped out of a kernel and userland and still have a functional system.
Sascha Wildner has pushed smart battery support, based on a patch from Dmitry Komissaroff and FreeBSD. He asks people to try it out. It apparently provides for more accurate battery charge level readings?
Francois Tigeot has updated the ixgbe(4) driver, and Sepherosa Ziehau has added TSO support for bce(4) and additional bge(4) related chips, mostly from the FreeBSD drivers.
Sascha Wildner has ported over more RocketRaid support, in the form of PCI IDs for various 4xxx and 3xxx series cards for hptiop(4), and a hpt27xx(4) driver that supports even more hardware.
Sascha Wildner’s added support (from FreeBSD) for the HighPoint RocketRAID 17xx, 22xx, 23xx and 25xx, via the hptrr(4) driver.
The ciss(4) device, if you don’t know offhand, is for a variety of SCSI-3 adapters – mostly ones labeled “HP Smart Array”. Sascha Wildner has imported a large number of driver updates from FreeBSD.
More benchmarks, in this case a comparison of Debian GNU/kFreeBSD and DragonFly. I’m not even sure how to derive meaning from it.
Sascha Wildner has synced find(1) with what’s in FreeBSD, which means there’s a lot more options available – see the commit for details. Many of them are for GNU compatibility, and I’m sure I’ll forget them all. I seem to have issues remembering how to use find(1) successfully.
Sepherosa Ziehau has added netblast, a tool originally from FreeBSD that, if I’m reading the commit right, flings packets of a given size at an IP/port of your choosing, for as long as you want.
A few recent updates imported to DragonFly from FreeBSD: Francois Tigeot updated amdsbwd(4), an AMD south bridge watchdog. Sascha Wildner updated arcmsr(4), the Areca RAID controller driver, and Peter Avalos updated pw(8).
In the other direction, FreeBSD now has GNU hash support for rtld, based on John Marino’s work in DragonFly.
It’s now possible to specify a jail ID when using pgrep and pkill(1), to capture processes specific to a jail. It’s similar to the same option in FreeBSD, except no compatibility issues since this option did not previously exist in DragonFly.
Michael Lucas installed WHMCS, a commerical hosting management tool, on FreeBSD. He tells a story of doing so, and in the process happened to list all the PHP modules needed for it to run. I’m linking it because that list is going to come in useful for someone, someday.
Sascha Wildner has brought in improvements to the mps(4)driver from FreeBSD. It’s for LSI Logic Fusion-MPT 2 SAS controllers, and apparently didn’t work very well… until now. Sascha’s commit message details what’s new, including RAID support that is not yet mentioned in the man page.
Deb Goodkin of the FreeBSD Foundation gets 24 minutes of interview on BSDTalk.
Since I’m already talking about imports, several changes from FreeBSD and OpenBSD for NFS, plus more original material, have been brought in by Venkatesh Srinivas. Those changes from FreeBSD apparently improve NFS write performance, though I don’t have numbers to show.
The FreeBSD Foundation is putting out their end of year donation notice. Donate if you can; the support for active developers there helps everyone.