Tag Archives: Storage

Ohio Section Journal – The Technical Coordinator – July 2024 edition

One of the responsibilities of the Technical Coordinator in the Ohio Section is to submit something for the Section Journal. The Section Journal covers Amateur Radio related things happening in and around the ARRL Ohio Section. It is published by the Section Manager Tom – WB8LCD and articles are submitted by cabinet members.

Once my article is published in the Journal, I will also make it available on my site with a link to the published edition.

You can receive the Journal and other Ohio Section news by joining the mailing list Tom has setup. You do not need to be a member of the ARRL, Ohio Section, or even a ham to join the mailing list. Please sign up!

If you are an ARRL member and reside in the Ohio Section, update your mailing preferences to receive Ohio Section news in your inbox. Those residing outside the Ohio section will need to use the mailing list link above.  Updating your ARRL profile will deliver news from the section where you reside (if the leadership chooses to use this method).

  • Go to www.arrl.org and click the Login button.
  • Login
  • When logged in successfully, it will say “Hello <Name>” in place of the Login button where <Name> is your name.  Click your Name.  This will take you to the “My Account” page.
  • On the left hand side, under the “Communication” heading (second from the bottom), click Opt In/Out
  • To the right of the “Opt In/Out” heading, click Edit
  • Check the box next to “Division and Section News.”  If it is already checked, you are already receiving the Ohio Section Journal.
  • Click Save
  • There should now be a green check mark next to “Division and Section News.”  You’re all set!

Now without further ado…


Read the full edition at:

THE TECHNICAL COORDINATOR
Jeff Kopcak – TC
k8jtk@arrl.net

Hey gang,

As if I needed another reason to talk about computers in here. Our Great Lakes Division Director, Scott – N8SY, informed me that ARRL HQ added items to the Technical Specialists responsibilities. In particular, ones beneficial to clubs needing direction with their website, E-mail, and storage. The new responsibilities are to:

3. Serve as an advisor to local clubs on web design and maintenance.
4. Serve as an advisor to clubs on web storage and email.

Many in the section’s technical crew have the knowledge or already do these things for their own club. Some ideas for storage and E-mail would be things like: how do we share files, collaborate and coordinate projects and activities. Next year’s Field Day perhaps? Maybe a way to keep in touch with the membership – such as a mailing list or Google Groups. Maybe the previous person responsible for these activities abandoned it, moved away, or otherwise left the club. We can work with and advise another member on ideas to revive that activity.

A solution many might be familiar with and use at work, SharePoint, is not something available to clubs for free or nearly free. There are Development (DEV) tenants for free but have limited lifetime and functionality. A solution such as groups.io has nearly all the features of a SharePoint site (up to 100 members for free) and not nearly as bulky. A club might decide to “roll their own” – self hosting services while retaining full control of their data – at a provider already available to the club.

Web sites can be beneficial to clubs. They are often the first interaction with potential new members and they keep existing members updated with the latest happenings, activities, and repeater information. A site with outdated information can leave potential members seeking a club that pays more attention to those details. With Content Management Systems (CMS), it’s easier than ever to build and maintain a website.

Responsive website automatically adjusts to different screen sizes and viewports (W3Schools)

According to BuiltWith, WordPress accounts for 44% of the 77.5 million sites running a CMS and Wix is second at 10.5%. Choosing a CMS has become a popular option because little to no coding is required. Hosting providers offer easy one-click installation solutions, too. One can easily make a site with WordPress by inputting some information and selecting a good template to display information in an attractive manner.

Get in touch with myself or one of the Technical Specialists to advise a club on any of these areas.

Previous look of the Wood County Amateur Radio Club site with left navigation on a mobile device

Personally, I use WordPress for my personal site and HamNationDSTAR.net – which I still maintain though no longer involved with the show.

Back in my day, I learned to use FrontPage to maintain websites. Though, schools were showing how to “build” web pages, and doing so, by exporting pages through Word. After taking a college class on HTML & CSS and working professionally as a programmer, I eventually realized the quality of code generated by that company’s products was (and still is) an abomination and entirely too bloated.

The Wood County Amateur Radio Club site started out as and remains my project to keep my web page skills going. It was first a FrontPage site. Then about 2008-2009, I rewrote the entire website by hand. To use buzzwords: “I optimized code.” Took out things that were generally being frowned upon in web design. The navigation pane and content pages were two iframes (pages within a page). Landing directly on a content page would not display the navigation iframe. As a workaround, I redirected the visitor to the homepage, which then loaded everything.

However, portable devices became much more popular. While WCARC pages would still work on smaller screens, it did require a lot of pinch-and-zooming because the navigation was static on the left side of the page. I knew about “responsive” websites because WordPress and other CMS’ I’ve used automatically render differently depending on screen size (phone, tablet, computer screen, TV, etc.) and orientation (vertical vs horizontal). I finally had some time to dig in around the beginning of this year.

When I rewrote the site the first time in ’08-09, I converted the site to use CSS (Cascading Style Sheets, a way to stylize and display elements within a web page). That saved a lot of time making the site responsive. If I wanted to make a different font selection or choose a different default size, that change is made in one place – while not having to edit a bunch of files/pages individually. With some exceptions for one-off style differences, all the styles are defined in the CSS.

I started out, as I often do, at W3Schools. They have a ton of how-to’s for different programming languages and real-time-editors to see modifications. The How TO – Responsive Top Navigation got things in motion. I took their idea and added my own touches to it. I changed the coloring to match the previous navigation, showing different colors to indicate when an item is hovered over and the current page the visitor is on. Then added icons to beautify the menu items. A camera for pictures, newspaper for the newsletter, people for meetings, and so on. The club has a Facebook presence and kept an “f” logo present in the navigation as well.

New look of the Wood County Amateur Radio Club site with collapsed navigation bar on a mobile device

A program that helped me render pages on my portable devices is called Cx File Explorer. My phone and tablet are Android devices. Using that app, I could save the file to my Network Attached Storage (NAS), then refresh Firefox or Brave browser on the Android device and see my changes instantly. I did not have to continuously upload the file a remote web server, for example. Cx creates a local web server on the device to serve up files as web pages to browsers on the device.

After the navigation changes were completed, moved on to sizing elements differently based on screen size and screen orientation. Font size on the header was too big when the navigation bar collapsed. I added font size changes for the header when the navigation bar is collapsed.

I wanted a way to have multiple elements that were spread out on a large computer screen to automatically display vertically when viewed on a mobile. On the home page, for example, these are the radar image, current time, solar activity and propagation near the bottom. On a computer screen, they are one next to the other, spread out horizontally. On a mobile, they stack themselves vertically such that they are one on top of the other.

The club calendar on the home page caused me the most grief. I like the monthly layout to note when events are happening and I want event titles to be seen. After many hours were spent futzing trying to get a one-size-fits-all, I couldn’t. The calendar size on a larger screen would not render well on a mobile device and vice-versa.

After fighting with the calendar for quite some time, came across an old post that gave me ideas. Have the monthly calendar displayed on larger screens and agenda view on a mobile screens. My prayers had been answered! That was the idea I needed.

Google Calendars offer different views (week, month, agenda) when embedded into a web page. Their helper generates different code based on the chosen options. That post gave me the idea to display the monthly view and hide agenda view on larger screens. Hide monthly view and display agenda view on smaller screens. Voilà.

After some weeks working on all the changes, I uploaded them and made them live. They’ve been running for about six months. The Wood County ARC site will render on a screen size as small as 450 pixels wide and renders to a max size of 3000 pixels wide and, of course, everything in between. Many people have thanked me for making the WCARC site work quite well and not crash their computer – meaning it doesn’t load an ungodly number of external resources and useless plugins. The site loads very little from external sources and most things needed to render pages are hosted on the Wood County Amateur Radio Club server itself.

Thanks for reading and 73… de Jeff – K8JTK

Ohio Section Journal – The Technical Coordinator – October 2021 edition

One of the responsibilities of the Technical Coordinator in the Ohio Section is to submit something for the Section Journal. The Section Journal covers Amateur Radio related things happening in and around the ARRL Ohio Section. It is published by the Section Manager Tom – WB8LCD and articles are submitted by cabinet members.

Once my article is published in the Journal, I will also make it available on my site with a link to the published edition.

You can receive the Journal and other Ohio Section news by joining the mailing list Tom has setup. You do not need to be a member of the ARRL, Ohio Section, or even a ham to join the mailing list. Please sign up!

If you are an ARRL member and reside in the Ohio Section, update your mailing preferences to receive Ohio Section news in your inbox. Those residing outside the section will need to use the mailing list link above.
Updating your ARRL profile will deliver news from the section where you reside (if the leadership chooses to use this method).
Go to www.arrl.org and logon.
Click Edit your Profile.
You will be taken to the Edit Your Profile page. On the first tab Edit Info, verify your Email address is correct.
Click the Edit Email Subscriptions tab.
Check the News and information from your Division Director and Section Manager box.
Click Save.

Now without further ado…


Read the full edition at:

THE TECHNICAL COORDINATOR
Jeff Kopcak – TC
k8jtk@arrl.net

DSCF5081 K8JTKHey gang,

Last couple times, I’ve been talking about my journey to preserve legacy media. First talked about different media formats and last month described how to create and use floppy disk images. This month is about optical discs, copy protection and storing images for preservation.

Optical disc images

Unlike floppy images, creating and mounting optical disc images was a hole other ball game. CDs have a variety of structures: data only (Digital Data), audio only (Digital Audio), CD-TEXT (artist and song details for Digital Audio), mixed mode (data on track 1, audio on tracks 2 – n), Enhanced CD (audio for audio players, data and multimedia for computers), and multi-session (data added or modified over subsequent writes to the disc). There are other standards such as MP3 CD, video CD, super video CD – those are all data tracks. DVD and Blu-ray are also data tracks.

Creating optical disc images

To meet my goal of having a raw data dump of optical media, Linux had the hardest time creating images. cdrao (CD recorder disc-at-once) can process different disc structures but the output files were not in a format most tools understand. Popular K3B disc writing program cannot make images of audio or mixed mode discs. dd won’t work either because it uses file structures (FAT, NTFS, Ext, CDFS, UDF). CD-audio is audio bits containing no file structure. Single track, digital data only discs were fine for Linux tools. Mixed mode and audio discs were a no-go.

On Windows, my long-time favorite, ImgBurn (freeware) made it all happen using the “Create image file from disc” option. Though not updated in some time, it still works well and the developer answers questions in the forum. It handled everything I threw at it. It defaults to ISO. If the disc doesn’t meet ISO9660 specifications, it creates the more flexible BIN & CUE formats. BIN file is binary data from the disc. CUE, for cue sheet, it a plain text file containing details about the tracks in the BIN file. This paring would be for CD-TEXT, multi-session, mixed mode, and Enhanced CD discs. UltraISO (trialware) created these images too and could output to different formats: ISO, Bin/Cue, Nero, Compressed, Alcohol, and CloneCD.

Copy protected discs

Then things went downhill quickly. One exception to “everything I threw at it” was copy protected discs. Copy protected discs aims to confuse the drive’s read system. A full read of a copy protected disc will fail. However, when activated, the protection software knows what to expect based on how it instructs the drive to read the disc. Many of these schemes are explained in this article. Other copy protection schemes install malware, called RootKits, that hides activities making detection and removal of the malware nearly impossible. Sony/BMG Music got caught installing RootKits in 2005. A user simply inserting the audio disc into their PC would unknowingly infect their system. As it turned out, companies were more concerned about their intellectual property and less about making software that didn’t have vulnerabilities. In the end, copy protection only hurts those who follow the rules.

I had one of those Sony/BMG discs. When I realized what they were doing, it was promptly returned. When referring to copy protected discs, I’m referring to a handful of unreadable game discs I have. Programs out there like Alcohol 120% (paid version) make perfect 1-to-1 copies, emulating copy protection schemes. It has been 15 years or more since I used those features but it worked great back then.

Failures creating working images using Alcohol 120% and CloneCD (trialware), which still tout making perfect 1-to-1 disc copies, I though was an issue with the application. After digging at the problem, I learned it’s probably not the fault of the application at all. First, I would identify discs with copy protection as ones ImgBurn showed had read errors. Next, make a new image of the disc using a 1-to-1 copy program. Then validate the image by installing the game on my Windows 7 64-bit operating system I was using to preserve legacy media. Finally, seeing if the game would run successfully. None of those games would launch. I spent waaaayyy too much time working under the presumption the problem was creating a good image. In reality, none (I mean NONE) of the copy protected games would run using their original discs. Imagine that, copy protection that doesn’t work.

ImgBurn creating a disc image of a CD-TEXT audio CD

Reasons copy protection wouldn’t validate successfully could be any of: a newer OS. These games are from the Windows 98/2000/XP era and cannot run on Windows 7. Running a 64-bit operating system when the copy protection drivers were written for 16 or 32-bit OSes. Could also be proactive blocking of the driver by Windows or Microsoft Security Essentials. With that information, though, I cannot say if those images created do or do not work. I would have to go down the road of getting an older operating system up-and-running. Could fire-up a Virtual Machine as well. I’ll pursue that later. Reading up on making images of copy protected discs, a disc drive that can read raw data is needed. While most noted drives state they read raw data, they really cannot. I couldn’t find a list of known working CD/DVD drives.

Avenues I looked into are sites that have cracks to bypass the copy protection validation schemes such as GameBurnWorld or GameCopyWorld. Not responsible for any damage or legal issues. This is for informational purposes only. Some cracks that I tried were for 16-bit OSes which is just not supported in a 64-bit OS. While I’m sure most of these games are available on a modern platform like Steam, I’m not feeling charitable enough to hand over more money to them seeing as they got it wrong the first time. Microsoft thinks Windows Compatibility Mode will fix all the problems. I think it only works on 32-bit versions of Windows. Most PCs are 64-bit, and 32-bit OS support is being dropped. I’ve never gotten any 16-bit Windows program to work in compatibility mode on a 64-bit OS.

Need to make copies of protected DVD or Blu-rays? See the products list at the CloneCD link above. Not responsible for any damage or legal issues. This is for informational purposes only. Unlike the game copy protection schemes which require software or a driver on the PC, DVD and Blu-ray store encryption keys on the disc which makes it fairly easy for programs like AnyDVD or DVDFab to read disc level encryption.

Mounting and using optical disc images

Things didn’t get much better when mounting disc images using virtual drives. Much like floppy disk mounting programs, I wanted something to emulate a CD drive on the host operating system. All programs I tried mounted ISO images to the operating system: Virtual CloneDrive (freeware), ImDisk (open source), Alcohol 120% (free edition), Daemon-Tools Lite (though installer is very bloated with crapware and maybe DNSBL on PiHole), UltraISO, and WinCDEmu (open source). Few of those programs mounted BIN & CUE correctly and even fewer handled multi-session images. Not all virtual drives are created equal. It may take some time to find a program or combination that works. In Linux, ISOs could be mounted using the “Disk Image Mounter” in the desktop GUI or using the command line (see part 2 in this series). Mounting BIN & CUE files in Linux required CDemu (open source).

Audio BIN & CUE files could only be mounted using Alcohol 120%, Daemon-Tools, and CDemu. An audio player like VLC (open source) would be used to play audio tracks. Foobar2000 (freeware) can play BIN & CUE files directly (without mounting). Enhanced CD and multi-session CD data tracks could not be accessed when mounted through any of the virtual drive applications I tried. Once the virtual drive hits the first lead-out in the image, that’s it. This affects images where data tracks follow audio tracks and multiple session images containing more than a single data track. I was never a fan of creating multi-session discs but I did have discs from friends that were.

Disc read errors. An indication of a copy protected disc.

UltraISO can access those data tracks from multi-session images and extract files. Maybe easier to copy the files from the disc to a folder instead of making an image for simplicity. There were two ISO editors listed for Linux, neither listed BIN & CUE file support. For completeness, all disc and structure data are still stored in the BIN image file and described in the cue sheet. It is a shortcoming of these virtual drive applications to not provide access to all data contained within the image. I have no idea why. Taking the same image and re-writing (burning) it to a blank disc would result in a complete copy of all sessions and data.

If possible, through the mounting software, mount the image READ ONLY! (see reasons in earlier parts). In addition, many virtualization and hypervisors such as DOS-box, VirtualBox, and vSphere can mount images naively to a guest operating system. Wikipedia has a comparison of disc image software applications for other suggestions.

Storing images

Lastly on this charade, storing these image files so they may live on forever! CD and DVD images are going to take up more disk space because the media can hold more data. Organize all images into a folder structure that makes sense: games, types of games, graphics, amateur radio, audio/video programs, operating systems, utilities, etc. I decided to store these images on my Network Attached Storage (NAS) with copies both off-line and off-site. The NAS file share is set for read-only to protect unintentional modification or deletion of the images or its contents.

Hard drives, until the beginning of this year, were relatively inexpensive. A 4-terabyte drive can still be purchased for around $100. Higher-capacity drives have been met with shortages and prices to reflect their supply. 4 TB is ALOT of storage. Use a new dedicated drive for storage, keep them on a local hard drive, or use an external hard drive. Make copies onto separate hard drives, USB thumb drives, or in “cloud” storage.

Plan a backup strategy sooner than later. The following is true for ANY data: data does not exist if it is not in two separate places. I argue three copies of data or it doesn’t exist (see #5 under “What can I do to protect myself?”): 3 copies of your data, 2 of them on different media (spinning hard-drive, sold-state SSD, thumb drive, optical, in the cloud, etc.), 1 must be off-site (at work, at a friend’s, storage locker – preferably temperature controlled/waterproof, safety deposit, with a relative, in the cloud).

Going more technical and into file system technology, use a file system that hashes files such as Btrfs or ZFS. Then scrub the data every couple-to 6 months. This keeps data in-check and detects errors in storage indicating media degradation or imminent failure. Linux has these features as do many NAS devices. Hashing protection and original floppies themselves are not additional copies. Hashing isn’t going to save data from a disaster (wind, power, tornado, fire, flood, physical destruction, theft, …). Original floppies do not count as a copy because this technology is dated, degrading, and getting harder to recover, a.k.a. legacy.

Recovery & file conversions

Half-Life Opposing Force copy protection disc authentication failure on original media

If you really, really, really want data back and are unable to recover it yourself, there are data recovery services. One ham said a person he knew used Gillware. A channel on YouTube I follow gave a recommendation to WeRecoverData. I did not use, research, or vet any of these companies so some due diligence is required before some phony-baloney service makes off with precious data. Gillware is a Micro-Center partner and WeRecoverData has a large number of companies that have used their services. Take that for what it’s worth.

Going back to my data that I “really, really, really” wanted to save from unreadable floppies. It turns out, I apparently told my younger self: self, you should make copies of these floppies onto other media or you may not have that data in the future. I copied all those important floppies, that are now unreadable, and burned them to CD. See, had two copies of data! I found those copies on a CD spindle of burned discs. Probably had read issues back then and saw the writing on the wall about floppies somewhere in the early 2000’s, near as I can tell. Writable CDs were reasonably priced about that time as well, $0.20, $0.30, $0.50, maybe as much as $1/each. I definitely didn’t know I could make an image of a floppy back then because the CD was drag-and-drop copies of the data. Better than not having it. Saved myself a lot of agony – although it doesn’t make as good of a story…

I didn’t touch on file conversions as the goal was to preserve data and I didn’t need to convert file formats. This may be needed in cases where proprietary programs were used and those companies no longer exist. The data can be read from the media but the file itself cannot be opened by any modern program. A copy of the original program used to create the file is best as there is likely some way to get that program running again. If it was an early version of a program that still exists, they may have changed data formats along the way and the earlier format is no longer readable by a modern version of the same program. Possibly filters or converters can be downloaded and installed.

Searching the Internet for the program originally used to create the file may lead to threads and worm-holes. Using an example of a very old word processing file, a similar-type program may be able to open the file such as Microsoft Office Word, Corel WordPerfect, LibreOffice Writer or legacy versions of old office suites like StarOffice or OpenOffice may improve chances. The more proprietary and obscure the program and format of the file, the harder it will be to find a program to read or convert the file, whereas open source programs and formats are likely to still be around 20 years later. I found enthusiasts will write free/open source programs to convert random obscure formats on GitHub.

Now that I’m done getting data off 3.5″ floppies, they’ll get destroyed for security reasons and donated to the circular file. I don’t see a reason to hang on to them seeing how many had read errors and now I have good copies of everything I want. I’m starting to see the same writing on the wall too with CD-R/DVD-R discs. A couple gave me read errors. Using another drive read the discs just fine. Still hanging on to those CD/DVD discs, until I get tired of looking at them.

While making disc images, I saw a name that sounded familiar: CMC Magnetics. Where have I heard that name before? If you were serious into your writable media mid-to-late 2000’s, a quick Internet search recalled memories of CMC being some of the cheapest & crappiest writable CD-R and DVD-R media available. Quality was not consistent, even between different spindles of the same brand. Verbatim was considered the gold standard for writable media. Even they got out of the market, selling off manufacturing to CMC. I think it’s the right time to get those important CDs and DVD-Rs imaged as well due to media quality concerns 😀

Epilogue:

I had one MacOS formatted floppy disk from grade school containing games that appears to use the HFS file system. Not much has gotten me anywhere near being able to play the games on that disk. I came across information for those needing to recover legacy Macintosh disks that’s worth passing along. Back in the early days, Apple developed a proprietary floppy disk technology to get more data on a standard 3.5″ floppy disk. Granted, everyone was trying to do their own proprietary formats to lock consumers into their technology and securing income for their company. Like proprietary technologies before and after it, users get shafted. The specific drives used to write those disks are the only ones that can read those floppy disks. Adding insult-to-injury, all recent MacOS versions have dropped support for those formats leaving users to find a branded drive with an appropriate legacy MacOS version should they want data off those disks. Not to mention, how will they get that data to a new system? A number of sources point to this website which has a lot of information to help MacOS users get their data recovered. Guess I’ll keep hoping to pick up an LC III or a LC 5xx from my early memories of MacOS.

Thanks for reading and 73… de Jeff – K8JTK

Ohio Section Journal – The Technical Coordinator – September 2021 edition

One of the responsibilities of the Technical Coordinator in the Ohio Section is to submit something for the Section Journal. The Section Journal covers Amateur Radio related things happening in and around the ARRL Ohio Section. It is published by the Section Manager Tom – WB8LCD and articles are submitted by cabinet members.

Once my article is published in the Journal, I will also make it available on my site with a link to the published edition.

You can receive the Journal and other Ohio Section news by joining the mailing list Tom has setup. You do not need to be a member of the ARRL, Ohio Section, or even a ham to join the mailing list. Please sign up!

If you are an ARRL member and reside in the Ohio Section, update your mailing preferences to receive Ohio Section news in your inbox. Those residing outside the section will need to use the mailing list link above.
Updating your ARRL profile will deliver news from the section where you reside (if the leadership chooses to use this method).
Go to www.arrl.org and logon.
Click Edit your Profile.
You will be taken to the Edit Your Profile page. On the first tab Edit Info, verify your Email address is correct.
Click the Edit Email Subscriptions tab.
Check the News and information from your Division Director and Section Manager box.
Click Save.

Now without further ado…


Read the full edition at:

THE TECHNICAL COORDINATOR
Jeff Kopcak – TC
k8jtk@arrl.net

DSCF5081 K8JTKHey gang,

Last time, I talked about a project I am working on to save data from legacy media: floppy disks, ZIP disks, and even optical media. This month I’ll cover programs and methods for creating floppy images and how to access data in image files.

Creating floppy disk images

I needed a program to create IMG files of these floppy disks. WRITE PROTECT disks before inserting into the drive to prevent accidental overwriting of the source disk! In Windows, I couldn’t find a decent program to make floppy images that wasn’t free. My usual go-tos failed me. Ones that did work as expected were WinImage (shareware, 30-day trial) and UltraISO (trialware). UltraISO is for creating, modifying, and saving CD/DVD images but has the ability to create floppy disk images too. Though, for some reason it doesn’t mount those images to the host operating system. dd for Windows is an alternative creator. dd is a well-known Linux conversion and copying program. If those don’t meet your needs, have a look at the Wikipedia article on disk image applications for a list of alternative options.

In general, on Windows, insert the floppy. Start the program. Select Make Floppy Image or Read Floppy. Then save the image file to the hard drive.

In Linux, making a floppy image can be completed with native tools. At the command line:

sudo dd if=/dev/fd0 of=/home/username/name_of_floppy.img
  • Failed to read from floppy using dd. dd will fail when it is unable to read a sector on the disk.

    if: “in file” or device to read data. /dev/fd0 is the common name in Linux for the first floppy disk drive

  • of: “out file” or device to write data

A better option to dd is ddrescue. That program is designed for data recovery, not only for floppies but CD-ROM and other media too. It will identify read errors and automatically re-read bad sectors hoping for one more successful read. Install through the Linux distro package manager. I had plenty of disks with read errors. Many were “oh, no – not that disk!” followed by moments of praying because I really, really, really wanted that data back. Some read errors were soft and easily recoverable. Others required manual intervention. My standard command line (one line):

sudo ddrescue -d -f -r5 /dev/fd0 /home/username/name_of_floppy.img /home/username/name_of_floppy.log
  • -d: direct access to the input file or device
  • -f: forces writing to the output file (if you locked the file somehow and ddrescue couldn’t write to the image file)
  • -rX: number of times to retry (X) reading bad sectors. I would set this value low initially, follow the methods below, and change to something like 150.
  • /dev/fd0: device to read (floppy drive)
  • /home/username/name_of_floppy.img: name and location of the output image file
  • /home/username/name_of_floppy.log: name and location of the output log file. This log is used to track sectors that could not be read, even across multiple runs of ddrescue.
ddrescue in progress

Once the initial run-through is completed with a couple attempts at re-reading bad sectors, the program can be terminated to blow debris off the magnetic medium or completely change out the disk drive. Re-run ddrescue with the exact same command and the program will continue retrying unreadable sectors of the same disk. Changing variables including giving things a rest for a few days will increase the chances of a successful read. One the disk is successfully read the log file is no longer needed.

My solutions for removing debris: bang the floppy physically to dislodge dust or other dirt. Blow across the magnetic medium while rotating to help do the same being careful not to introduce moisture, which would cause more harm. I saw this referred to as the “shake & blow” method. That got me through a good number of iffy disks. Trying another disk drive resolved even more errors. Some disks could not be completely read or there were so many read errors making the chances of total recovery slim to none. A number of excellent suggestions are available on this site dealing with copy protection, disk errors, and drive errors.

When ddrescue is unable to completely read the entire disk, try straight drag-and-drop copying of files to the hard drive. Entirely possible ddrescue is spending time on sectors that don’t contain usable data. Should that not work, let ddrescue do its thing as much as it can, mount the image, then try copying the files from the mounted image. ddrescue may not be able to recover the disk in its entirety but data it was able to read might be usable. I’m still praying for those disks that I considered important.

I didn’t find an exact equivalent to ddrescue for Windows. Searching online indicated a program like BadCopy Pro (trial) or TestDisk (free, open source) might be able to recover disk data at the file level, not at the sector level for the image. I’ve used TestDisk and derivative programs previously but did not test these programs for floppy data recovery.

Mounting and using floppy disk images

Pheew, making floppy images is done and the disks that were able to be read are preserved. Now, how to use these image files? They can be mounted to the operating system acting like another floppy or removable media disk drive. If so desired, the image contents can be modified. I do not recommend nor wanted any modifications to the image file once completed. If possible, through the mounting software, mount the image READ ONLY! Installers often write parameters or logs to the original media. The goal is to leave the img file completely intact as it was read form the original source disk. I didn’t want to risk having images modified from disks that took a long time to recover in ddrescue.

Mounting floppy image in ImDisk

If modifications are needed, make a copy of the image file and mount the copy for writing. If not available through the mounting software, or as an additional layer of protection, I made a file share on my NAS (network attached storage) that is marked read-only in the NAS configuration. After placing image files in that file share, setting the read-only property does not allow any write capability to that file share.

ImDisk (free, open source) worked well for mounting. It allows the device type to be changed or read-only options set to prevent modification. Selecting device type: floppy, check removable media, and check read-only are settings that worked best. In Fedora, I could use the “Disk Image Mounter” in the desktop, or at the command line (one line):

sudo mount -o ro /home/username/name_of_floppy.img /home/username/folder/to_mount_image
  • -o ro: sets the read-only flag
  • -t vfat/iso9660: maybe needed if mount cannot determine the image file system type

Many virtualization and hypervisors such as DOS-box, VirtualBox, and vSphere can mount images naively to a guest operating system.

Next time, CD/DVD disc images, storing images, and finally, the conclusion. Optical media images are harder to create, work with, and copy protection: the bane of my existence.

If you are a new ham or looking to improve your station and you weren’t able to attend Technical Specialist Jason – N8EI’s presentation “Beyond the Baofeng: Thoughts on Equipment Choices for New Hams,” you missed a great opportunity. It was a well throughout presentation and he made some great points. In attendance were a couple non-hams that wanted to become licensed. They were there trying to figure things out and he provided helpful information. The session was recorded and will be posted online at some point. I’m sure that will be announced when it is available. Don’t forget, Technical Specialists are available for presentations at club meetings or hamfests. If your club is looking to fill a program slot, reach out to Jason for his presentation or myself for ideas.

Speaking of hamfests, I made it to two more over the past month: Findlay Hamfest and the Cleveland Hamfest and Computer Show. At Findlay, I felt it was well attended. Not the numbers they’ve seen in the past, likely due to the on-going state of the world, but I was pleasantly surprised. I spent some money on connectors, couple gadgets, and found another power supply for my universal battery charger. Since it’s not available anymore, I wanted a backup incase the current one stops working. Could have spent a lot more money as I’m starting to look at smaller formfactor PCs – and they had a couple. Definitely saw a number of the disk drives I talked about in last month’s article. Good place to find them if you need ’em, just sayin’! Attendance seemed good, considering, at Cleveland too. That one is more of a social event for me as it’s my home turf and I run into a lot of hams I haven’t seen in some time. I also attended the presentation on one of my favorite linking modes, AllStar. All-in-all, two strong hamfests I recommend attending next year.

Thanks for reading and 73… de Jeff – K8JTK

Ohio Section Journal – The Technical Coordinator – February 2021 edition

One of the responsibilities of the Technical Coordinator in the Ohio Section is to submit something for the Section Journal. The Section Journal covers Amateur Radio related things happening in and around the ARRL Ohio Section. It is published by the Section Manager Tom – WB8LCD and articles are submitted by cabinet members.

Once my article is published in the Journal, I will also make it available on my site with a link to the published edition.

You can receive the Journal and other Ohio Section news by joining the mailing list Tom has setup. You do not need to be a member of the ARRL, Ohio Section, or even a ham to join the mailing list. Please sign up!

If you are an ARRL member and reside in the Ohio Section, update your mailing preferences to receive Ohio Section news in your inbox. Those residing outside the section will need to use the mailing list link above.
Updating your ARRL profile will deliver news from the section where you reside (if the leadership chooses to use this method).
Go to www.arrl.org and logon.
Click Edit your Profile.
You will be taken to the Edit Your Profile page. On the first tab Edit Info, verify your Email address is correct.
Click the Edit Email Subscriptions tab.
Check the News and information from your Division Director and Section Manager box.
Click Save.

Now without further ado…


Read the full edition at:

THE TECHNICAL COORDINATOR
Jeff Kopcak – TC
k8jtk@arrl.net

DSCF5081 K8JTKHey gang,

I don’t know about anyone else, since most of us have been told to cower-in-place, my productivity has gone through the roof! Must be that 10-foot commute between the work desk and home desk, might get the sun in my eyes on my way over. Finally tacking items on the perpetual “when I have loads of free time” list.

First cleaned out my data hard drive that had become a general dumping ground for downloads, pictures, data files, abandoned projects, and all other forms of miscellaneous files. Kept telling myself ‘I’ll organize this later.’ I figure accumulation started around the time I graduated with my undergrad (2008) and really got involved with ham radio. Go figure. Downloads had grown to 2,900 files at 16 GB and the general dumping ground was around 73,000 files at 314 GB. Much of that got deleted but enough was kept for reference or sentimental reasons.

Synology NAS

After sorting, mutilating, and “organizing,” this led into another task to better utilize my NAS, or Network Attached Storage, functionality more than I currently was. NAS devices are a way to attach storage, like hard drives or SSDs, to the network for sharing data across devices on a local network or, in special cases, users on the Internet. NAS devices can be anything from a Raspberry Pi with USB hard drives attached, an old computer filled with spare hard drives running FreeNAS, to specifically designed devices from companies such as Synology, QNAP, or Asus. Many think “storage” when they think NAS because storage: it’s in the name. Consumer NAS devices offer packages that can be installed to add additional functionality commonly available through always-on devices. Functionality options such as a mail server, web server, git server, database server, docker virtualization, replication (mirroring, backup with another provider), network level authentication, VPN, IP camera DVR, chat, and document collaboration. I’m a loooong time Western Digital user. Their Red line of NAS drives are my choice, though they tried to pull some crap of quietly introducing sub-par drives (don’t use WD Red drives with “EFAX” in the model). Seagate is stepping up their game too with the IronWolf line, which is gaining popularity.

My strategy is to move files I’m not actively using on a regular basis to the NAS. These types of files would be: digital pictures, Office documents, document scans, emails, news articles, previous taxes, internet downloads, audio/video clips, newsletters, ham projects, school work and projects, old programs that aren’t updated but are still useful. Unbeknownst to me when I started, this didn’t leave a whole lot left over on my desktop data drive. Maybe in the future, I’ll move all data to the NAS.

For the remaining data left on my data drive, I still wanted to maintain a backup strategy in case something happened to those files. Anything from my own stupidity (accidental deletion, encrypted by a malware strain) to hardware failure. Previously, I used a cloud provider for remote backup but they decided to exit the consumer market. With their change in business strategy, I was using my own scripts to keep things synced from the desktop to the NAS, whenever I remembered to run them. Not great because if I deleted something with a bunch of recent changes and the last backup I had was a week or two ago, that sucks. This syncing strategy also didn’t have file versioning.

When a file is changed, the backup system preserves a new copy of the file but keeps previous versions in case you wanted to go back in time to an earlier version. Real-world example: a computer becomes infected with a malware strain that encrypts all pictures and documents. A backup solution will still make a backup copy of the newly encrypted file, because it doesn’t know its user or user on the network did something stupid. Saving previous versions means you can recover the unencrypted version without paying Mr. Bad Guy’s ransom.

Syncthing web interface (wikipedia.org)

I tried solutions like rsnapshot but had serious issues getting systemd timers (supposed to replace cron, yeah, we’ll see) to work with persistence and waiting until the NAS was mounted before taking a snapshot. That was abandoned after a few months. I heard about Syncthing on a podcast. It met my requirements and more! It’s quite an amazing piece of free and open-source technology. I could run an instance on my NAS (or any computer), attach devices, those devices send file changes in real time, and the software takes care of preserving previous versions. “More” came in the form of Syncthing being available on every platform I use. Supported are: source code for manual compiling, Linux (many distributions and processor architectures), Windows, macOS, *BSD, and Solaris. There is an Android client allowing me to backup my phone to my NAS. Syncthing is exactly what I needed since I have some Windows machines (like the shack PC).

A couple warnings about Syncthing. Getting started will seem overwhelming with options and what they mean. Look at good tutorials and in the forums where there are lot of users willing to help. Even more important: Syncthing IS NOT a backup tool. Wait, you said you are using it as a backup tool! I’m syncing file changes to my NAS. Backup comes in the form of making images of the NAS drive and storing those off-site. Also acceptable is using a cloud backup service to backup the NAS off-site. Both are acceptable uses of Syncthing as a “backup” solution.

Another thing on the “to do when I have tons of free time” was digitize VHS tapes. In December & beginning of January, I was on a mission to digitize my high school and college video tapes as well as family home videos. Close to 100 tapes in total. Those that are not familiar with my broadcast television past, I was involved with WHBS-TV in high school, a local cable access station. Schools from across the county came to visit us because we were doing 7 camera shoots with replay for all football games, 5 camera shoots for basketball, and competing in college level categories for regional Emmy awards. Worked at WBGU-TV in college. Did a ton of cool stuff including weekly productions for Fox Sports Ohio, a program that was distributed internationally, and lots of remote shoots in different parts of the state, to name a few. This was all before over-the-air digital was a thing. I recorded a lot of stuff on VHS tapes over those years and, of course, wanted to preserve them.

Most say “put it on DVD.” Like it or not, we’re being pushed to a streaming society so companies can control when and how you view content. Not only is physical media dead, but you now have to take care of, and store, a bunch of DVDs. There are services allowing you to roll-your-own streaming service, where you to make your own content library. There would be a server on your network containing your music, videos, TV shows, home movies, etc. making it accessible to smart TVs, streaming devices like Roku or Fire Stick, smart phones, tablets, or any modern web browser.

Plex media center (plex.tx)

I used a Hauppauge USB capture device to digitize VHS tapes played from a VCR. VideoReDo to fix errors in the data stream (some players have issues playing video streams with data errors) and cut recordings into smaller files. HandBrake to encode the video and Plex Media Server to make the video available to devices. Plex server runs on, you guessed it, the NAS! I’m glossing over how to use Plex, organize files, and produce files optimal for streaming as there are many support articles and forum posts covering these topics on the Plex or any other similar service’s site.

Reading up on recommended practices to digitize VHS tapes, VCRs with newer Time-Based Correctors (TBC) were recommended. Looking online, those were $400 or more. Since it’s likely these videos will be watched a handful of times, I decided to forgo more expensive VCR options. TBC can correct timing issues, making 1 second = 1 second, not longer due to tape stretching. It aims to correct visual image jitter and “wiggling.” I did see those artifacts and re-recorded if the video was bad enough. The Hauppauge device captures video at about 13 mbps (2 hr is about 13 GB). “Lossless” 25 mpbs capture devices were recommended. Do you remember the quality of a VHS tape? Lossless is not going to lose much VHS quality! All tapes digitized weighed in at about 1 TB of storage. Sounds like a lot. Though, 4 TB drives are under $140.

Watching college videos from 2004 as they were being digitized, I came across one of the shows and said ‘that guy looks familiar.’ It was two shows on school funding in the state of Ohio. Our previous section SGL Nick Pittner – K8NAP was one of the guests. I happen to be working camera in the WBGU studio for that show and Nick was in Columbus coming in via satellite. Emailed Nick some screen grabs. He remembered the show, hosts, other guest, and said they are still fighting the same fight after the better part of two decades later. Sometimes you never know who you’re working with!

On a commute a little longer than 10 feet, I’m planning to be in person at the Portage County Amateur Radio Service (PCARS) meeting coming up March 8th. Meeting topic will be VoIP modes (Voice over IP), both analog and digital, and the DVMIS. Hope to see everyone. There should be a Zoom link posted on their site if you would like to attend virtually.

Mike Baxter, KA0XTT, played by Tim Allen (arrl.org)

Speaking of the DVMIS, the Last Man Standing Amateur Radio Club – KA6LMS is sponsoring a special event starting at 00:00 UTC on March 24, 2021 and end at 23:59 UTC on March 30, 2021. This coincides with the last day of shooting for the show which is concluding its long, successful run. This event is going to be a multi-band, multi-mode, special event celebrating the show for its portrayal of amateur radio. AmateurLogic.TV is planning a net for March 27 from about 7 pm – 1 am eastern and the net will be carried on my system! I’m honored to be part of this event as Last Man Standing is one of my favorite shows. Mark your calendars and check the KA6LMS QRZ page for details!

Thanks for reading and 73… de Jeff – K8JTK

Ohio Section Journal – The Technical Coordinator – September 2020 edition

One of the responsibilities of the Technical Coordinator in the Ohio Section is to submit something for the Section Journal. The Section Journal covers Amateur Radio related things happening in and around the ARRL Ohio Section. It is published by the Section Manager Scott – N8SY and articles are submitted by cabinet members.

Once my article is published in the Journal, I will also make it available on my site with a link to the published edition.

You can receive the Journal and other Ohio Section news by joining the mailing list Scott has setup. You do not need to be a member of the ARRL, Ohio Section, or even a ham to join the mailing list. Please sign up!

If you are an ARRL member and reside in the Ohio Section, update your mailing preferences to receive Ohio Section news in your inbox. Those residing outside the section will need to use the mailing list link above.
Updating your ARRL profile will deliver news from the section where you reside (if the leadership chooses to use this method).
Go to www.arrl.org and logon.
Click Edit your Profile.
You will be taken to the Edit Your Profile page. On the first tab Edit Info, verify your Email address is correct.
Click the Edit Email Subscriptions tab.
Check the News and information from your Division Director and Section Manager box.
Click Save.

Now without further ado…


Read the full edition at:

THE TECHNICAL COORDINATOR
Jeff Kopcak – TC
k8jtk@arrl.net

DSCF5081 K8JTKHey gang,

On this month’s edition of “Pi Talk” – just when you thought I couldn’t talk about Pi anymore! I received a question from Chet – K8KIZ who has a laptop used for station operation. He wanted to replace it with a Raspberry Pi. In searching, he found way too many choices and wanted help to set him on the right path. This might be a question that others have or one they are considering. He soon found out it was a lot more complicated than originally thought.

Over the past number of years, I’ve done a lot of integration work which involves making one system or application talk to or replace another. It frequently involves bridging communications with other services such as databases or API’s (application programming interface) and facilitating data flow between them. Sales, Account Managers, and System Engineers for the new vendor will always throw around buzzwords and catch phrases – “setup and integration are easy and seamless,” “automated,” “zero configuration,” “drop-in replacement,” “pays for itself in three days” (not really), “reduce costs.” List goes on and on. It is never any of those things.

They have absolutely no idea about your environment, how involved, and how costly it will be to utilize their services. They just want you to buy them. Soon after comes the nickel-and-dimming: “you want to process how much data? That’s an extra couple thousand dollars” or “that doesn’t come with the license you purchased, that will cost you an extra-large-number with many 0’s!” Internal business units do this too. They weren’t prepared or made it seem like they are in position to handle a situation and were not. Feature requests take an extraordinarily long time to implement or claims of not having enough man-power soon follow.

The FCC is in a situation similar to this or they’re making it seem like they are: ‘oh, our licensing process is all digital and we can eliminate that pesky licensing fee!’ And the peasants rejoice. Reading the latest news about the FCC wanting to reinstate license service fees, “…we propose a nominal application fee of $50 due to automating the processes, routine ULS maintenance, and limited instances where staff input is required.” Wait, isn’t that why they went digital to reduce these costs? Someone sold them a bill-of-goods that didn’t actually reduce their costs or they’re looking to recoup costs elsewhere.

Not wanting the same thing to happen to Chet, where the alternative didn’t actually improve his situation, I took the approach of having him think about his station. What does he use his station for and what he would consider “a success” of replacing his laptop with a Raspberry Pi? Anytime anyone is looking to replace X with Y, an evaluation of this nature. What is X used for and are the pros/cons of Y sustainable?

In Chet’s case, replacing a laptop used for ham radio with a Raspberry Pi, he would need to consider things such as:

  • Is the current laptop setup Windows or Linux?
  • If it’s Windows, would he want to climb the Linux learning curve?
  • Is he using any software apps that are Windows only? Examples would be: RT Systems programmers, Ham Radio Deluxe, N3FJP logging, SmartSDR, N1MM, Wires-X, etc., etc.
  • Can those Windows only apps be replaced by Linux apps – and are those Linux apps equally as good?
  • Does he have any hardware requirements (like multiple serial or parallel ports)? The Pi has UART via GPIO pins but two or more serial ports require USB-to-Serial converters.
  • How many USB ports are required? Pi’s only have 4. 2 ports would be taken up by using a wired keyboard and mouse.
  • Do all of his hardware devices and interfaces work in Linux? These would be things like radio programming, control (CI-V) or firmware flashing, audio mixers and audio interfaces.

This is not an all-inclusive list especially since I didn’t know anything about his station – though I seem to remember he was into Vibroplex CW key tuning and repair from a local hamfest. I thought through scenarios that might apply to the majority of HF operators and came up with that list.

G4DPZ running GPredict on a Pi (amsat-uk.org)

Some Windows programs can be run under Linux using a compatibility layer program such as WINE or run virtual machines (VMs). That would contribute to the Linux learning curve. Raspberry Pi isn’t powerful enough today to run VMs. VMs or hypervisors maybe an option for some Linux desktop/laptop situations.

Instead of wired keyboards and mice, Bluetooth devices could be a replacement option but are more costly. Wired is preferred to wireless for reducing interference problems. Built-in antennas for Bluetooth or Wi-Fi aren’t going to be as good as laptop antennas. Additionally, monitors without HDMI or mini-HDMI connectors will need adapters, cables, or outright replaced if it doesn’t have compatible connectors. USB hubs are an option for expanding the number of USB ports. I have yet to find a USB hub that is problem free. They don’t work well with some operating systems, attached devices do not fare well with temporary connection interruptions, and they tend to break down after a short time.

Best way to track these considerations and more is to make a list. Start by looking at all connections to the existing laptop, both physical and virtual (like with an SDR). Include any software used during operating (radio control, prediction modeling, packet, digital, etc.). Programming radios? Those tend to be Windows (or DOS) programs along with firmware updaters. If using a Raspberry Pi is still desired, another Windows machine will be needed for programming and firmware updates. Include all of these in the list and evaluate solutions on the Raspberry Pi or Linux platform for alternatives that meet the requirements. Consider splitting non-supported, but essential, functionality to another Windows machine.

Another way to approach evaluation would be to operate with a new “Pi” system, hands-on, but keeping the old system up-and-running nearby. The old system would be used as a reference for program settings, coping or migrating data files (such as export from one and import to the other), and a comparison point when evaluating Linux programs.

Lastly, completely ditching the previous system and entirely starting from scratch is an option. This type of evaluation style is more draconian by ripping and replacing. Most people have their own operating style and rarely want to deviate from their ritual. Rip-and-replace might be needed if they’re fed up with a current setup and want to start over with something else. The operator, in this case, would not care about migrating previous data, starting out anew, and take whatever options are offered by a different platform.

Raspberry Pi 3 projects for Ham Radio with 7-inch touchscreen (qrznow.com)

To future proof, I’d recommend going with the latest version of the Pi. Currently, that would be a Raspberry Pi 4 Model B with at least 4GB RAM ($60), 8GB ($90) if able to spring for the extra RAM. Quality of the power supply and SD card plays a role in stability as I talked about in July. Data corruption possibility is still not zero. Even on a desktop PC. Corruption seems to be more prevalent on Pi’s, likely because of cheap components chosen by the user.

I strongly recommend making frequent data backups. This applies to any system. There should be 3 copies of data: the local copy (on the Pi), another copy on a storage device like a USB Hard Drive or Network Attached Storage (NAS). A third copy, off-site, located at a friend’s house, relative’s house, or a work location. Another off-site storage location would be cloud storage or backup service provider. Think about where you would be if you lost those LOTW logs, FT8 contacts, SSTV images, or Winlink messages. This strategy is known as the 3-2-1 backup strategy and should be used for ANY important data. 3 copies of data, 2 on different medium, and 1 copy off-site.

Starting out, I would consider the “Ham Pi” or “Build a Pi” projects I discussed in August initially. “Ham Pi” has just about every Linux ham radio application pre-installed. That would allow an operator to try different programs, find one that suits their needs or one they prefer. “Build a Pi” can be a little more tailored to operating style. You can also get down and dirty by compiling programs from source, depending on Linux experience or desire to tinker with Linux.

That just about covers broad considerations. Chet realized this was a larger undertaking than finding a plug-and-play option. He appreciated the analysis of the issues at hand. I hope he is able to find a working solution to replace his station laptop. When considering major overhauls such as this, know that for most people, it’s a little more complex and involved than most realize.

A quick note about Winlink. The WINMOR protocol has been deprecated systemwide and will soon be removed from the client software application. First introduced by Rick – KN6KB in 2008, it was the first ‘sound card’ mode offered by Winlink as an alternative to modem hardware needed at the time. Rick and the Winlink Team have moved on to developing robust and speedier protocols such as Amateur Radio Digital Open Protocol (ARDOP) and VERA HF. RMS gateways will only support ARDOP, VARA HF, and Pactor 3 or 4 (where applicable) near term. If you are still using WINMOR, it’s likely been hard to find gateways that support the protocol because sysops have been asked to remove in favor of the other modes. WINMOR had a great run and was the mode I used when I first got on Winlink.

Thanks for reading and 73… de Jeff – K8JTK

Ohio Section Journal – The Technical Coordinator – July 2018 edition

One of the responsibilities of the Technical Coordinator in the Ohio Section is to submit something for the Section Journal. The Section Journal covers Amateur Radio related things happening in and around the ARRL Ohio Section. It is published by the Section Manager Scott – N8SY and articles are submitted by cabinet members.

Once my article is published in the Journal, I will also make it available on my site with a link to the published edition.

You can receive the Journal and other Ohio Section news by joining the mailing list Scott has setup. You do not need to be a member of the ARRL, Ohio Section, or even a ham to join the mailing list. Please sign up!

If you are an ARRL member and reside in the Ohio Section, update your mailing preferences to receive Ohio Section news in your inbox. Those residing outside the section will need to use the mailing list link above.
Updating your ARRL profile will deliver news from the section where you reside (if the leadership chooses to use this method).
Go to www.arrl.org and logon.
Click Edit your Profile.
You will be taken to the Edit Your Profile page. On the first tab Edit Info, verify your Email address is correct.
Click the Edit Email Subscriptions tab.
Check the News and information from your Division Director and Section Manager box.
Click Save.

Now without further ado…


Read the full edition at: http://arrl-ohio.org/news/2018/OSJ-Jul-18.pdf

THE TECHNICAL COORDINATOR
Jeff Kopcak – TC
k8jtk@arrl.net

DSCF5081 K8JTKHey gang,

Around the time of Dayton, the FBI asked everyone to reboot their routers. Why would they do that? Over the last two years more than 500,000 consumer and small business routers in 54 countries have become infected with a piece of malware called “VPNFilter.” This sophisticated malware is thought to be the work of a government and somewhat targeted with many of the infected routers located in Ukraine.

Src: Cisco’s Talos Intelligence Group Blog

Security researchers are still trying to determine what exactly VPNFilter was built to do. So far, it is known to eavesdrop on Internet traffic grabbing logon credentials and looking for specific types of traffic such as SCADA, a networking protocol controlling power plants, chemical plants, and industrial systems. Actively, it can “brick” the infected device. Bricking is a term to mean ‘render the device completely unusable’ and being as useful as a brick.

In addition to these threats, this malware can survive a reboot. Wait, didn’t the FBI ask all of us to reboot our routers? Won’t that clear the infection? No. In order for this malware to figure out what it needs to do, it reaches out to a command-and-control server. A command-and-control server issues commands to all infected devices, thus being “controlled.” C&C, as they are often abbreviated, allows the bad guys in control a lot of flexibility. It can allow infected devices to remain dormant for months or years. Then, the owner can issue commands to ‘wake-up’ the infected devices (called a botnet) and perform intended tasks. Tasks can range from attack a site, such as DynDNS which I wrote about in November of 2016, to steal logon credentials for users connected to the infected router. Back to the question, the FBI seized control of the C&C server. When an infected router is rebooted, it will try to reach out to the C&C server again but instead will be contacting a server owned by the FBI. This only gives the FBI a sense of how bad this infection is. Rebooting will not neutralize the infection.

Affected devices include various routers from Asus, D-Link, Huawei, Linksys, MikroTik, Netgear, TP-Link, Ubiquiti, Upvel, and ZTE, as well as QNAP network-attached storage (NAS) devices. There is no easy way to know if your router is infected. If yours is on that list, one can assume theirs is infected. As if that wasn’t bad enough, many manufactures don’t have firmware updates to fix the problem. The ones that have fixed the problem did so years ago. Since no one patches their routers, that’s why there’s half a million infected.
First thing to do is gather information about the make, model, and current firmware of your router. Then check for announcements from the manufacturer about affected firmware versions or preventative steps. The only known way to clear this infection is to disconnect it from the Internet, factory-reset the router, upgrade the firmware (if one is available), and reconfigure it for your network – or simply throw it away.

If those last couple words strike fear into your heart, there are a couple options:

  • See if your ISP has a device they will send or install for you. It can be reasonably assumed that devices provided or leased by the ISP will be updated by the ISP.
  • Find someone in your club that knows at least the basics of networking to help reconfigure things
  • Many newly purchased devices come with some sort of support to get you up and running

If you’re a little more advanced and want to learn more about networking:

  • EdgeRouter-X
    Use 3rd party firmware. Currently they are not showing signs of being vulnerable to VPNFilter or other infections. 3rd party firmware projects are often maintained by enthusiasts. They are updated LONG past when the manufacturer stops supporting their own products and updates often happen quickly. Some of those projects include: OpenWRT/LEDE, DD-WRT, or Fresh Tomato.
  • A Linux box could be setup with Linux packages to mimic router functionality or use a distribution such as pfSense or OPNsense.
  • Another great device to use is the Ubiquity EdgeRouter-X for $49.
  • Check the “Comparison of Firewalls” for other ideas.

That $5 hamfest deal isn’t sounding so great anymore. It’s the law of economics for these companies too. $10, $30, or $100 for a device isn’t going to sustain programmer’s time to find, fix, troubleshoot, test, and release firmware updates for a 7-year-old device. It’s a struggle. I think it will come down to spending more on better devices which will be upgraded longer or spend $50-$100 every 3-5 years to replace an OK one.

The Department of Commerce released a report on the threat of botnets and steps manufactures could take to reduce the number of automated attacks. It hits on a number of good points but lacks many details. “Awareness and education are needed.” Whose responsibility is it to educate? I can write articles in the OSJ but I’m not going to be able to visit everyone’s house and determine if your devices are infected. “Products should be secured during all stages of the lifecycle.” Automated updates could take care of this problem but doesn’t address what-ifs. What if the update fails or worse yet, bricks your “Smart” TV as an example? Who is going to fix or replace them? Will they be fixed if it’s out of warranty? Not to mention operating system “updates” are bundled with more privacy violations and ways to monetize users.

There’s a lot of work to be done. I wish I had the answers. Regardless, we all need to be good stewards of the Internet making sure ALL attached devices are updated and current.

More technical details on VPNFilter and citation for this article: https://www.schneier.com/blog/archives/2018/06/router_vulnerab.html
https://blog.talosintelligence.com/2018/05/VPNFilter.html

Finally this month, thank you to all the clubs and groups that sent messages to this station via WinLink or NTS over Field Day weekend. It was the most I’ve ever received, about 12 – 15 messages altogether.

Thanks for reading and 73… de Jeff – K8JTK