Actions

Difference between revisions of "DXing Digital Utilities"

From The RadioReference Wiki

m
m
 
(32 intermediate revisions by 2 users not shown)
Line 1: Line 1:
==Equipment and Connections==
+
'''NOTICE: The rules about listening to signals not intended for you applies here. The contents of many signals might be considered sensitive by the party sending and the reception of such signals may be illegal in your country. The authors neither condone or encourage such acts'''
If you decide to get into digital, you will need better equipment than a simple portable. While some portables will work with reasonably stronger signals, the more complex the signal (or conditions), the more a portable will fall short. Tuning accuracy, selectivity, stability and even mode selection play a significant role in being able to correctly tune a signal.
 
  
 +
This document is designed to give utility listeners a sampling of the kinds of signals and sounds available on shortwave (HF) radio today along with information on the available equipment needed to understand, analyze or identify these signals. Our primary focus is to present the parameters that define the most commonly heard systems as an aid for utility monitors and not an exhaustive discussion of HF
 +
digital signaling theory. 
  
While the number of newer desktop receivers has plummeted, a sharp eyed listener can often find such receivers at hamfests. Do your homework - use the [[:Category:Receiver Reviews|Receiver Reviews]] article to begin your research. Even though most of the reviews do not specifically refer to digital capabilities, keep an eye on some of the characteristics mentioned earlier. Those folks with a modern ham transceiver have an advantage - they often have a general coverage receiver built in.
+
Digital Utility listening is inherently more difficult than regular shortwave listening. The possibility of decoding the signal received adds another level of complexity. This document is an attempt to describe to hobbyists what digital signals can be received and decoded, in addition to providing the more advanced listener with a little more technical data to identify an otherwise unknown signal.
 
 
 
 
In the case of connecting a receiver to the PC soundcard, a clean connection is a must. This [[Connecting Radios to Soundcards|article]] from our wiki describes some pitfalls and solutions. It's strongly encouraged to make the connection with shielded audio cable to restrict the possibility of stray noise pickup. However, you will need to experiment with the soundcard settings on the PC to see which works for you. There's no way to present a guide for each and every instance, as there is wide variation in models and quality, depending on the soundcard installed on the PC.
 
 
 
 
 
The big push these days is in the development of Software Defined Radios (SDRs). Many are very capable at HF; one of their biggest advantages is being able to see a large swath of frequencies, all at one time. For modes like ALE, which show up for a few seconds and are sometimes gone, this is a big plus for capturing data quickly. See our [[Software Defined Radios]] article for numerous reviews and other technical information on this subject.  
 
 
 
 
   
 
   
Connecting a PC soundcard to your SDR may require the use of some Dynamic Link Libraries (DLLs) that must be installed. With others you can use software like Virtual Audio Cable (VAC) to route the audio from the SDR to the PC. Those packages that can directly interface with SDRs are shown in {{color|green|green}} on the [http://www.chace-ortiz.org/umc/software.html Utility Monitoring Central] website.
+
Herein lies the basic problem with digital utility listening - lack of information. Many systems are used by Military or Diplomatic Services and information on the specifics of a particular mode are impossible to find, even from the manufacturer. Many are considered proprietary, but that doesn't mean that a signal can not be identified. With the proper tools a given signal can be identified via the way it sounds (aurally) or how it looks (visually). Most of the more expensive decoders that include some kind of signal analysis can ID a signal by bit-pattern or baud rate. Once a signal is identified there are many decoders that can print the traffic for you; however, keep in mind there may be various kinds of encryption in use with these signals. Encryption types include figure group or letter group messages and even random bit-masking or bit stream encryption, which looks like a continuous stream of random characters. You may often read the term "on-line" and "off-line" used in conjunction with various encryption schemes. Generally, off-line encryption is taken to mean groups of letters or numbers (most usually groups of five), whereas on-line schemes just appear as a continuous stream of random characters.
 
 
 
 
==What about software?==
 
 
 
* The [http://www.chace-ortiz.org/umc/software.html Utility Monitoring Central] website lists packages for PCs, Macs and even a few for Ipads. Some are free, some not.
 
* Marius Rensen's popular [http://www.hffax.de HF FAX] site has more information on FAX software and schedules
 
 
 
 
 
==Why cant I decode this signal?==
 
Let's be clear at the outset - there are many digital signals that will '''never''' be decoded. Unlike digital signals in the amateur radio service, there are many that are encrypted to prevent casual viewing. Most are assumed to be military in nature. The challenge is to find signals that '''can''' be decoded, or at least identified.
 
 
 
 
 
==What are all those strange sounds?==
 
 
 
The first task is to properly identify the mode. There are numerous digital modes, and a casual examination of the Utility DXers Forum on Yahoo groups would turn these up.
 
 
 
 
 
* [[ALE]]. This mode is often used to test the propagation path between 2 stations, and to sometimes pass short messages. The link provides more information on this mode as well as compatible software. Note that this one of the newer modes that hams, as well as non-hams, utilize.
 
 
 
 
 
* Digital Selective Calling (DSC). This [http://www.ndblist.info/index.htm website] has a great deal of information, as well as links to software that can read this mode.
 
 
 
 
 
* FAX (Facsimile) - Most often used for weather charts, and on rare occasions, news items. Happily this is one mode that is easy to both recognize and decode.
 
 
 
 
 
* HF Datalink ([[HFDL]]), also known as HF ACARS. See the linked article for more information.
 
 
 
 
 
* Link11 - See the [[Link-11]] article. 
 
 
 
 
 
* SITOR-B - Also known as AMTOR Mode B, FEC or NAVTEX, this mode is often used for maritime weather and warnings from various organizations. This [http://www.ndblist.info/index.htm website] also has a great deal of information on this mode. While not used by the amateur community much anymore, it still enjoys wide popularity in the maritime community.
 
 
 
 
 
* STANAG 4285 - Most often used by the French and NATO forces. See this [http://www.udxf.nl/Some%20Notes%20on%20STANAG%204285.pdf article (PDF)] from the Utility DXers Forum homepage on identifying and decoding this mode. Often the traffic is encrypted, but the IDs are not, making it easy to at least identify the users. Occasionally you will get lucky and catch the stations running test loops (in French: Voyez Le Brick) which identifies the station.
 
 
 
 
 
While there are many digital signals that are easy to identify, many are not. There are just as many modes that most people have never heard of. This [http://www.udxf.nl/list%20of%20digital%20systems.pdf article (PDF)] is a list of those modes that have been identified, but there are likely more that have never been identified or classified. It's quite possible that these modes are military in nature. These modes could be encrypted and very difficult, if not outright impossible, to read.
 
 
 
 
 
==So how can we identify the users of these modes?==
 
 
 
In some cases, the frequencies used by these modes are well known and widely published (such as HFDL). This is, of course, but one clue in identifying a user. We need another tool to help narrow the field.
 
 
 
 
 
Some older modems and TNCs (for example the Universal M-7000) had the ability to attempt to guess what mode a particular signal was sending (some very expensive
 
soundcard decoders also have this ability). Unfortunatly these classifiers can be fooled by a poor signal level or noise - so it's not always the best choice for determining the mode of a signal
 
 
 
 
 
Many digital decoding packages have the ability to display an audio representation of the signal being received. This ability comes by many names; sonogram, waterfall display or audio spectrum display, just to name a few. This [http://www.udxf.nl/Living%20Sonagram.pdf article (PDF)] describes in some detail how to use a sonogram and how to record the signal. Both are important - you may need to play the signal back several times before you get a clear picture of what the signal looks like. The accuracy of the sonogram is going to be greatly influences by many factors; the quality of the signal being received, your receiving setup and the PC you are using will all play a role here.
 
  
 +
Keep in mind that you must be able to find a signal before you can apply the power of the decoder on the signal for identification and possible decoding. Most signals found on the airwaves today are obvious with easily distinguishable sounds, from chirping to two tone FSK to musical multitone MFSK, but as communication technology develops this will most likely change. It is safe to say that the more efficient a modulation/coding method is, the more noise like it must become. It has been said in some digital groups that "Any sufficiently advanced communication is indistinguishable from noise".
  
It should be noted that new modes show up from time to time that take considerable knowledge and skill to properly analyze.  
+
This document covers the following areas. Please click on the desired topic;
  
  
Now what about identifying the patterns shown in the sonogram?
+
; Chapter 1. Receivers and PC Connections
 +
*[[A Few Words on Receivers]]
 +
*[[Making the Connection to the PC]]
 +
*[[Connecting Radios to Soundcards]]
  
  
These links have pictures of sonograms (and in some cases audio samples) of numerous kinds of digital signals. You can use these as a guide, but remember, it's another clue as to the mode (and by extension, sometimes the potential user) of the signal
+
; Chapter 2. How Do I Decode A Signal I Find on HF?
 +
*[[Decoders|A Discussion About Decoders]]
 +
*[[HF Hardware Decoders]]
 +
*[[HF Software Decoders]]
 +
*[[Utility Monitoring Central Links]]
  
* [http://www.bartg.org.uk/modesamples.asp British Amateur Radio Teledata Group Mode Samples]
 
* [http://www.w1hkj.com/FldigiHelp-3.21/Modes/index.htm Digital Modes - Sight & Sound]
 
* [http://www.bcar.us/digsig.htm Digital Signal Audio Reference]
 
* [http://det.bi.ehu.es/~jtpjatae/sound.html Eduardo Jacob's Home Page- Sound Files]
 
* [http://hfradio.org.uk/html/digital_modes.html G4UCJ's Radio Website]
 
* [http://sferix.myweb.hinet.net/hfasia/ HF Asia Sound Files]
 
* [http://www.iarums-r1.org/iarums/sound/main.html IARU Monitoring System Region 1 Sound Files]
 
* [http://www.jvcomm.de/soundframee.html JVCOMM32 Sound Samples]
 
* [http://www.kb9ukd.com/digital/ KB9UKD Digital Modes Samples]
 
* [http://www.qsl.net/lu8mbr/digimodos.htm LU8MBR Digimodos (Spanish)]
 
* [http://www.mixw.net/index.php?j=signals MixW digital signal examples]
 
* [http://f1ult.free.fr/DIGIMODES/MULTIPSK/digimodesF6CTE_en.htm MultiPSK - Digital Mode Samples]
 
* [http://www.nonstopsystems.com/radio/radio-sounds.html NonStop Systems Radio Sound Samples]
 
* [http://signals.radioscanner.ru/base/ Signals RadioScanner RU Signal Samples] (page partially in Russian)
 
* [http://signals-analysis.blogspot.com/ Signals Analysis Blog]
 
* [http://www.sigidwiki.com/wiki/Signal_Identification_Guide Signal Identification Guide (wiki)]
 
* [https://www.youtube.com/user/FirstToken/videos Token's Audio Samples]  includes several digital signals
 
* [http://www.udxf.nl/modes.html UDXF Audio Samples]
 
* [http://wb8nut.com/digital/ WB8NUT Digital Information Page]
 
* [http://www.qsl.net/zl1bpu/ ZL1BPU Fuzzy Modes]
 
  
 +
; Chapter 3. Modes and Sounds
 +
*[[HF Modes List]]
  
==Testing Your New Setup==
 
Instead of hunting for readable signals, check out the following links for schedules. Please read them carefully to see if the software you are using is compatible.
 
* [http://www.dwd.de/bvbw/generator/DWDWWW/Content/Schifffahrt/Sendeplan/Schedule__rtty__01,templateId=raw,property=publicationFile.pdf/Schedule_rtty_01.pdf DWD RTTY Broadcasts for Shipping (PDF)]
 
* [http://www.dxinfocentre.com/maritimesafetyinfo.htm HF SITOR Broadcasts by William Hepburn]
 
* [http://www.radiomarine.org/gallery/show?keyword=ksmstation&panel=pab1_2#pab1_2 KSM Marine and Press Broadcasts]
 
* [http://www.dxinfocentre.com/navtex.htm NAVTEX Broadcasts by William Hepburn]
 
* [http://www.nws.noaa.gov/om/marine/rfax.pdf NOAA Worldwide FAX Schedule] (PDF)
 
* [http://www.nws.noaa.gov/om/marine/hfsitor.htm USCG Sitor-B Broadcasts]
 
* [http://voaradiogram.net/ VoA Radiogram Digital Tests]
 
* There have been a few reports of WLO sending RTTY and NAVTEX weather on 8472 Khz. The exact schedule is not confirmed.
 
  
 +
; Chapter 4. Articles
 +
*[[Selected Articles from the WUN Archives]]
  
==YouTube Videos==
 
* These are YouTube links to videos that mention the following software packages. Note that due to the broad nature of the search, other links could also be here. If the software is not linked in any of the above sections, then see the [http://www.chace-ortiz.org/umc/software.html Utility Monitoring Central] Software page for links to the software itself.
 
* [https://www.youtube.com/results?search_query=Radiocom+6 Bonito Radiocom 6]
 
* [https://www.youtube.com/results?search_query=fldigi FLDigi]
 
* [https://www.youtube.com/results?search_query=code300-32 Hoka Code 300-32]
 
* [https://www.youtube.com/results?search_query=JVComm JVComm32]
 
* [https://www.youtube.com/user/k2nccvids K2NCC Various examples of decoding]
 
* [https://www.youtube.com/results?search_query=krypto500 Krypto500]
 
* [https://www.youtube.com/results?search_query=MixW MixW]
 
* [https://www.youtube.com/results?search_query=multipsk MultiPSK]
 
* [https://www.youtube.com/results?search_query=PC-ALE PC-ALE]
 
* [https://www.youtube.com/results?search_query=PC-HFDL PC-HFDL]
 
* [https://www.youtube.com/results?search_query=Rivet+java+software Rivet]
 
* [https://www.youtube.com/results?search_query=Seatty SeaTTY]
 
* [https://www.youtube.com/results?search_query=Sigmira Sigmira]
 
* [https://www.youtube.com/results?search_query=W-Code Wavecom W-Code]
 
  
 +
; Chapter 5. Scheduled and Easy to Hear Stations
 +
*[[Testing Your New Setup]]
  
== Are there other resources?==
 
  
The RR forum for this article can be found [http://forums.radioreference.com/shortwave-data-decoding/ here]. In addition, this [http://www.chace-ortiz.org/umc/links.html page] at the Utility Monitoring Central website lists various mailing lists devoted to specific software packages. Go here for technical support for them first.
+
; Chapter 6. References
 +
*[[HF Appendix]]
  
  
The [https://groups.yahoo.com/neo/groups/UDXF/info Utility DXers Forum] (UDXF) Yahoo group is an excellent place to help identify the mode and user of a particular signal. There are also specialized Yahoo groups (such as the one for [https://groups.yahoo.com/neo/groups/hfdl/info HFDL]) that can supply updated software or active frequencies. There are also ircchat sites (see <nowiki>irc://irc.starchat.net/wunclub </nowiki>) where you can ask questions, and get nearly immediate responses. These are often your best sources of information.
 
  
 
[[Category:HF Topics]]
 
[[Category:HF Topics]]
 +
[[Category:HF Signal Analysis and Decoding]]

Latest revision as of 22:42, 29 January 2021

NOTICE: The rules about listening to signals not intended for you applies here. The contents of many signals might be considered sensitive by the party sending and the reception of such signals may be illegal in your country. The authors neither condone or encourage such acts

This document is designed to give utility listeners a sampling of the kinds of signals and sounds available on shortwave (HF) radio today along with information on the available equipment needed to understand, analyze or identify these signals. Our primary focus is to present the parameters that define the most commonly heard systems as an aid for utility monitors and not an exhaustive discussion of HF digital signaling theory.

Digital Utility listening is inherently more difficult than regular shortwave listening. The possibility of decoding the signal received adds another level of complexity. This document is an attempt to describe to hobbyists what digital signals can be received and decoded, in addition to providing the more advanced listener with a little more technical data to identify an otherwise unknown signal.

Herein lies the basic problem with digital utility listening - lack of information. Many systems are used by Military or Diplomatic Services and information on the specifics of a particular mode are impossible to find, even from the manufacturer. Many are considered proprietary, but that doesn't mean that a signal can not be identified. With the proper tools a given signal can be identified via the way it sounds (aurally) or how it looks (visually). Most of the more expensive decoders that include some kind of signal analysis can ID a signal by bit-pattern or baud rate. Once a signal is identified there are many decoders that can print the traffic for you; however, keep in mind there may be various kinds of encryption in use with these signals. Encryption types include figure group or letter group messages and even random bit-masking or bit stream encryption, which looks like a continuous stream of random characters. You may often read the term "on-line" and "off-line" used in conjunction with various encryption schemes. Generally, off-line encryption is taken to mean groups of letters or numbers (most usually groups of five), whereas on-line schemes just appear as a continuous stream of random characters.

Keep in mind that you must be able to find a signal before you can apply the power of the decoder on the signal for identification and possible decoding. Most signals found on the airwaves today are obvious with easily distinguishable sounds, from chirping to two tone FSK to musical multitone MFSK, but as communication technology develops this will most likely change. It is safe to say that the more efficient a modulation/coding method is, the more noise like it must become. It has been said in some digital groups that "Any sufficiently advanced communication is indistinguishable from noise".

This document covers the following areas. Please click on the desired topic;


Chapter 1. Receivers and PC Connections


Chapter 2. How Do I Decode A Signal I Find on HF?


Chapter 3. Modes and Sounds


Chapter 4. Articles


Chapter 5. Scheduled and Easy to Hear Stations


Chapter 6. References