Entropy, Randomness, /dev/random vs /dev/urandom, Entropy Sources, Entropy Gathering Daemons, RDRAND
From Whonix
< Dev
Introduction[edit]
The Linux Kernel man page [archive] says: "[...] /dev/random should be suitable for uses that need very high quality randomness [...]".
Quoted from the riseup.net page about entropy [archive]: "[...] entropy-estimation is a black-art and not very well understood [...]".
While it would be good to be cautions, i.e. learning about the entropy quality in Virtual Machines and if required learning about methods to improve it, it is not a critical problem. Successful entropy estimation attacks have never been reported for any software.
User space (not kernel space) entropy failures:
- https://lists.debian.org/debian-security-announce/2008/msg00152.html [archive]
- Lessons from the Debian/OpenSSL Fiasco [archive] / Random Number Bug in Debian Linux [archive]
Kernel entropy failures:
We performed a large-scale study of RSA and DSA cryptographic keys in use on the Internet and discovered that significant numbers of keys are insecure due to insufficient randomness.
Most critically, we found that the Linux random number generator can produce predictable output at boot under certain conditions,
Every software package we examined relies on /dev/urandom to generate cryptographic keys; however, we find that Linux’s random number generator (RNG) can exhibit a boot-time entropy hole that causes urandom to produce deterministic output under conditions likely to occur in headless and embedded devices
Interesting:
https://blog.cr.yp.to/20140205-entropy.html [archive]
Quality[edit]
As long as one entropy source of many is high quality, this foils attempts by adversaries to predict output and rescues the RNG.[1]
RDRAND[edit]
Debian trusts RDRAND by default since Debian buster. Quote https://www.debian.org/releases/buster/amd64/release-notes/ch-information.en.html#entropy-starvation [archive]
Due to systemd needing entropy during boot and the kernel treating such calls as blocking when available entropy is low, the system may hang for minutes to hours until the randomness subsystem is sufficiently initialized (random: crng init done). For amd64 systems supporting the RDRAND instruction this issue is avoided by the Debian kernel using this instruction by default (CONFIG_RANDOM_TRUST_CPU).
Non-amd64 systems and some types of virtual machines need to provide a different source of entropy to continue fast booting. haveged has been chosen for this within the Debian Installer project and may be a valid option if hardware entropy is not available on the system. On virtual machines consider forwarding entropy from the host to the VMs via virtio_rng.
If you read this after upgrading a remote system to buster, ping the system on the network continuously as this adds entropy to the randomness pool and the system will eventually be reachable by ssh again.
See the wiki [archive] and DLange's overview of the issue [archive] for other options.
security-misc [archive] (installed by default in Whonix ™) distrusts the CPU for initial entropy at boot as it is not possible to audit, may contain a bug, weaknesses or a backdoor.
RDRAND should not be trusted.
- sets
random.trust_cpu=off
kernel boot parameter - Linux kernel developer Theodore Ts'o warning against RDRAND [archive]
- entropy CONFIG_RANDOM_TRUST_CPU yes or no? / rng_core.default_quality [archive]
- https://en.wikipedia.org/wiki/RDRAND#Reception [archive]
- https://twitter.com/pid_eins/status/1149649806056280069 [archive]
- https://archive.nytimes.com/www.nytimes.com/interactive/2013/09/05/us/documents-reveal-nsa-campaign-against-encryption.html [archive]
- https://forums.whonix.org/t/entropy-config-random-trust-cpu-yes-or-no-rng-core-default-quality/8566 [archive]
- https://www.metzdowd.com/pipermail/cryptography/2014-October/023349.html [archive]
- https://www.lvh.io/posts/2013/10/thoughts-on-rdrand-in-linux/ [archive]
- Ars Technica: AMD shipped Ryzen 3000 with a serious microcode bug in its random number generator. [archive]
- Kernel bug report from 2014: rdrand instruction fails after resume on AMD family 22 CPU [archive]
https://www.phoronix.com/scan.php?page=news_item&px=Linux-RdRand-Sanity-Check [archive]
https://www.phoronix.com/scan.php?page=article&item=crosstalk-srbds-vulnerability&num=1 [archive]
In T727#16542 [archive], @HulaHoopWhonix wrote:
Playing devil's advocate here: Ted Ts'o [0] expresses strong skepticism about the efficacy of RNGs that rely on CPU jitter. summary: CPU jitter may not be random as thought to someone who designed the CPU cache and know how its internals "tick" [1]. So while these RNGs may not harm, another solution for RNG-less platforms may be a good idea.
[0] He's the main developer behind Linux's RNG and staunchly resisted relying only on Intel's RDRAND. His opinions carry weight with good reason.
[1] https://lwn.net/Articles/586427/ [archive]
It may be that there is some very complex state which is hidden inside the the CPU execution pipeline, the L1 cache, etc., etc. But just because *you* can't figure it out, and just because *I* can't figure it out doesn't mean that it is ipso facto something which a really bright NSA analyst working in Fort Meade can't figure out. (Or heck, a really clever Intel engineer who has full visibility into the internal design of an Intel CPU....)
- D. J. Bernstein: https://groups.google.com/g/randomness-generation/c/z3Uid45DV34 [archive]
- https://spideroak.com/browse/share/UTwente/RNG/Tests/NIST-STS/ [archive]
- https://spideroak.com/share/KVKHOZLOORSQ/RNG/home/quantum/SpiderOak%20Hive/Tests/NIST-STS/SP800-22rev1a.pdf [archive]
- https://github.com/QubesOS/qubes-issues/issues/6941 [archive]
Write to /dev/random[edit]
Quote Wikipedia:
This could use a better source. While the contents can be confirmed this write-up is good.
It is also possible to write to
/dev/random
. This allows any user to mix random data into the pool. Non-random data is harmless, because only a privileged user can issue the ioctl needed to increase the entropy estimate. The current amount of entropy and the size of the Linux kernel entropy pool, both measured in bits, are available in/proc/sys/kernel/random/
and can be displayed by the commandcat /proc/sys/kernel/random/entropy_avail
andcat /proc/sys/kernel/random/poolsize
respectively.
/dev/random
by default is world-writable. Unprivileged users can write to it. If that was considered insecure /dev/random
would not be world-writable by default. In other words, nothing written to /dev/random
can lower the entropy quality of the system. This would only be risky if the entropy was credited using ioctl.
Related: rndaddentropy - An RNDADDENTROPY ioctl wrapper
risks writing to /dev/random[edit]
Patrick:
Mixing even fully compromised entropy sources is considered secure in the current Linux kernel implementation. Though, D. J. Bernstein disagrees with that: https://blog.cr.yp.to/20140205-entropy.html [archive]
Quote [archive] 3hhh [archive]:
Bernstein assumes that you have entropy sources that you trust and some that are less trustworthy. If that's true, his statement on "stick with the single one you trust and ditch all other input" is correct (and you only need 256 bits or so exactly once).
However the Linux guys assume that you don't want to ultimately trust any of the entropy sources available to you (or are too uninformed to make the decision) and thus live with a few potential attacks.
I believe the latter is a more realisitic view atm (Linux runs on many "suboptimal" devices).
If you build your own hardware RNG and use that, Bernstein's view is more accurate.
https://forums.whonix.org/t/risks-of-writing-to-dev-random-crediting-entropy-rndaddentropy-related-to-untrusted-root/8976 [archive]
Credit Entropy[edit]
- https://web.archive.org/web/20191031233802/https://systemd.io/RANDOM_SEEDS.html [archive]
- https://www.freedesktop.org/software/systemd/man/systemd-random-seed.service.html [archive]
$SYSTEMD_RANDOM_SEED_CREDIT
refers to this as "credit the entropy" vs "not credit the entropy".
Quote http://man7.org/linux/man-pages/man4/random.4.html [archive]
ioctl
RNDADDTOENTCNT Increment or decrement the entropy count of the input pool by the value pointed to by the argument.
RNDADDENTROPY
Add some additional entropy to the input pool, incrementing the entropy count. This differs from writing to /dev/random or /dev/urandom, which only adds some data but does not increment the entropy count. The following structure is used:
struct rand_pool_info { int entropy_count; int buf_size; __u32 buf[0]; };Here entropy_count is the value added to (or subtracted from) the entropy count, and buf is the buffer of size buf_size which gets added to the entropy pool.
It is safer to improve the actual entropy but not credit it. The rationale here is if whatever is being developed here won't ever worsen entropy. The only requisite for that is that assumption that nothing written to /dev/random can worsen the entropy. If entropy was credited and the added entropy was flawed, the security could be actually worsened. Therefore the same strategy that systemd is implementing by default - adding entropy but not crediting it - is the safer way to implement new entropy generators. Better for entropy but no gain in performance.
If we added extra entropy and credited it: the process would be faster but less secure. I don't think we should make the process faster at the expense for higher risks. That would be possible but would require this solution to generate traction and peer review.
If we added extra entropy and credited it,
- in best case: entropy quality increases
- in worst case: we waste CPU cycles, increase lines of Whonix ™ source code, waste time and accomplish no entropy quality increase but also no entropy quality degradation.
Goals:
- Main goal: improve entropy quality
- Improving boot time (credit entropy): non-goal
- Not worsening boot time so that nobody wants to use Whonix ™ anymore: goal
- Price to pay: slightly increased boot time / system load
/dev/random vs. /dev/urandom[edit]
https://github.com/smuellerDD/jitterentropy-rngd/issues/6#issuecomment-939110351 [archive]
Viewpoint: "/dev/random is obsolete" has been deprecated. It's still available as a footnote. [2]
Better use /dev/random
.
Here is what renown cryptographer Dr. Daniel J. Bernstein has to say on the matter. [3] The quote was cut to simplify things.
[...] but Linux /dev/urandom ([...]) spews predictable data [...]
Quote without cutting the parentheses. (Underline is mine. code
is mine.)
[...] but Linux
/dev/urandom
(unlike Linux/dev/random
) spews predictable data [...]
Oversimplified interpretation:
- He's saying that
/dev/random
does not spew predictable data. - In other words, he's saying that
/dev/random
produces random data. - He's saying that
/dev/urandom
spews predictable data.
Quoting whole paragraph.
I'm not saying that
/dev/urandom
has a perfect API. It's disappointingly common for vendors to deploy devices where the randomness pool has never been initialized; BSD/dev/urandom
catches this configuration bug by blocking, but Linux/dev/urandom
(unlike Linux/dev/random
) spews predictable data, causing (e.g.) the widespread RSA security failures documented on http://factorable.net [archive]. But fixing this configuration bug has nothing to do with the/dev/random
superstitions.
Interpretation:
- He's saying that
/dev/urandom
spews predictable data if the randomness pool has never been initialized.
A randomness pool that has never been initialized is an issue in many cases:
- first boot
- inside virtual machines
- first boot inside virtual machines
- golden images without random seeds
- golden images coming with published, shared (among all users of the golden image) random seeds
The issue of randomness pool initialization is well elaborated at systemd Random Seeds [archive].
Finally, I need to address what my interpretation is what he means by "superstitions". Quote:
the
/dev/random
superstitions.
Related paragraphs. Quote:
Cryptographers are certainly not responsible for this superstitious nonsense. Think about this for a moment: whoever wrote the /dev/random manual page seems to simultaneously believe that
(1) we can't figure out how to deterministically expand one 256-bit /dev/random output into an endless stream of unpredictable keys (this is what we need from urandom), but
(2) we _can_ figure out how to use a single key to safely encrypt many messages (this is what we need from SSL, PGP, etc.).
For a cryptographer this doesn't even pass the laugh test.
Interpretation: He is only talking about people who think that /dev/random
should always be used. Should always be considered more secure. Even in cases where randomness pool initialization is done. That is superstitious and I think that is a fair argument. The problem is, that it is non-trivial to know the status of randomness pool initialization. Therefore that is a rather theoretic consideration.
Quote systemd Random Seeds [archive]:
(Strictly speaking there are more APIs, for example
/dev/random
, but these should not be used by almost any application and hence aren’t mentioned here.)
This could use some elaboration. Hence, asked, see systemd feature request: systemd.io/RANDOM_SEEDS - elaborate on /dev/random [archive]
My conclusion is:
- Prefer using
/dev/random
whenever security is important such as for key generation. /dev/random
provides higher quality assurance than/dev/urandom
. No conditionals./dev/urandom
might be OK depending on randomness pool initialization./dev/random
is OK either way.
- This is specifically important at early boot when it's non-obvious if randomness pool initialization is done yet.
- How to check the status of randomness pool initialization? Non-trivial.
- Just make sure that
/dev/random
produces enough random data which is doable nowadays thanks to these software packages listed on this page. /dev/urandom
might be providing the same level of entropy quality as/dev/random
does, but due to the previous point, for simplicity, there is no reason to use/dev/urandom
.
My simplified conclusion is:
- Use jitterentropy-rng kernel module, jitterentropy-rng user space daemon, haveged and whatnot.
- And then simply use
/dev/random
.
Proponents of the viewpoint that "/dev/random
is obsolete, use /dev/urandom
, always" should explain:
- Why Linux offers both,
/dev/random
and/dev/urandom
and why if it is "really the same" isn't just a symlink from the one to the other. - Why Linux does not use the same code paths for
/dev/random
and/dev/urandom
? Why have this distinction in the first place?
Kernel developer Theodore Y. Ts'o in 2019: https://lore.kernel.org/linux-ext4/20190915052242.GG19710@mit.edu/ [archive]
The plain simple reality of entropy - Or how I learned to stop worrying and love urandom by Filippo Valsorda — @FiloSo, Cryptography and systems engineering at CloudFlare, Entropy_32c3_16-9.pdf
[archive] should according to Patrick Schleizer not be used to dismiss entropy quality considerations. The pdf mentions "The early boot problem", quote:
Very early at boot, /dev/urandom might not be seeded yet, predictable. This is a Linux shortcoming. The OS must save the entropy pool at poweroff. Your distribution probably does already.
Exactly such mechanisms need to be scrutinized. For example, Qubes OS does not persist random seed files (entropy) in TemplateBasedVMs #1752 [archive], reported 2016, unfixed at time of writing October 2021.
Entropy Sources[edit]
Introduction[edit]
It has to be researched if they do work well inside Virtual Machines. Simply installing all of them may not be wise.
early-rng-init-tools[edit]
- https://lists.debian.org/debian-devel/2019/02/msg00383.html [archive]
- https://lists.debian.org/debian-devel/2019/02/threads.html#00327 [archive]
- http://fish.mirbsd.org/~tg/Debs/dists/sid/wtf/Pkgs/early-rng-init-tools/ [archive]
- https://pkgs.org/download/early-rng-init-tools [archive]
- https://evolvis.org/plugins/scmgit/cgi-bin/gitweb.cgi?p=alioth/early-rng-init-tools.git;a=tree [archive]
- https://forums.whonix.org/t/early-rng-init-tools-for-better-entropy/8579 [archive]
use kernel command line as a source of randomness[edit]
Introduction
[1] Kernel will use kernel command line as a source of randomness in any case - whether a random seed is added to kernel command line or not. Sources:
- https://www.openwall.com/lists/kernel-hardening/2017/08/16/15 [archive]
- https://lore.kernel.org/patchwork/cover/822010/ [archive]
- https://lore.kernel.org/patchwork/patch/822011/ [archive]
- https://lore.kernel.org/patchwork/patch/822012/ [archive]
adding a random seed to kernel command line
Goal: see goal.
Design:
- Do not credit entropy since this might be dangerous if something goes wrong.
- Non-goal: Fixing performance related early entropy issue since there is none.
- systemd unit file drop-in for
systemd-random-seed.service
[archive] by addingExecStartPost
to refresh seed early at boot to avoid re-using the same one.ExecStopPost
to mix in new entropy that was collected since last boot.
- add a
randomseed=
parameter to kernel command line- The kernel does not support a
randomseed=
parameter directly. But the kernel uses kernel command line as a source of entropy. The keywordrandomseed=
could be replaced with any other keyword. This is just for self-documenting purposes. I.e. by reading the web searching for and reading the scripts, clues are given why what is being done.
- The kernel does not support a
Similar to:
- Adding a random seed to kernel command line would be similar to
systemd-random-seed.service
[archive] (enabled by systemd and Debian default) but happening earlier already at boot stage of initial ramdisk.systemd-random-seed.service
by default also does not credit entropy. - Also similar to early-rng-init-tootls but without its potential security issues since not crediting entropy.
Disadvantages:
- Does not work at first boot.
- Does not work for live boot but no worse than too due to [1].
Advantages:
- Same as
systemd-random-seed.service
but already available at boot stage initial ramdisk.
timer_entropyd[edit]
- https://www.vanheusden.com/te/ [archive]
- Not in Debian. [archive]
- https://github.com/adrelanos/timer-entropyd [archive]
- https://www.whonix.org/pipermail/whonix-devel/2020-January/001500.html [archive]
- Quote https://www.kernel.org/doc/ols/2014/ols2014-harris.pdf [archive]
I have written a daemon program which I believe solves this problem. I wanted a name distinct from the existing“Timer entropy daemon” [2], developed by Folkert vanHeusden, so I named minemaxwell(8), after Maxwell’s demon, an imaginary creature discussed by the great physicist James Clerk Maxwell. Unlike its namesake, however, my program does not create exceptions to the laws of thermodynamics.
The timer entropy daemon uses floating point math in some of its calculations. It collects data in a substantial buffer, 2500 bytes, goes through a calculation to estimate the entropy, then pushes the whole load of buffered data into random(4). My program does none of those things.
- Quote https://metacpan.org/pod/release/DANAJ/Crypt-Random-TESHA2-0.01/lib/Crypt/Random/TESHA2.pm [archive]
Uses a related method (jitter in timing data between usleeps) as this module, but inefficient and only suitable for bulk feeding of an entropy pool. Even after von Neumann debiasing, the output has distinct patterns and at most 0.5 bits of entropy per output bit. HAVEGE is a superior overall solution. However, note a number of other links at the site for other sources as well as links to hardware RNGs.
- Quote https://github.com/infinity0/rngutils/blob/master/README.md [archive]
(This was inspired by timer entropy daemon^TED, which generates entropy in an inefficient way, and whose output fails FIPS 140-2.)
- Quote http://www.freepatentsonline.com/y2019/0050202.html [archive]
The timer entropy daemon uses timing jitters over sleeps to produce entropy, much like MAXWELL. This demon is even more lightweight than MAXWELL, and makes no attempt to spice things up by doing small calculations, rather it only uses a 100 s sleep wrapped by gettimeofday(2) sampling.
sound based[edit]
randomsound[edit]
- In Debian. [archive]
- randomsound is being discouraged nowadays by its author [archive].
- https://forums.whonix.org/t/moar-entropy-sources/8543 [archive]
- revive randomsound? [archive]
- reply to above [archive]
audio-entropyd[edit]
- Not in Debian. [archive]
- asked [archive]: Confirmed by author to not cache audio input same for video. [archive]
- Might not be advisable due to the same reasons randomsound is being discouraged nowadays by its author [archive]?
turbid - High-Entropy Symbol Generator[edit]
- http://www.av8n.com/turbid/ [archive]
- http://www.av8n.com/turbid/paper/turbid.htm [archive]
- Not in Debian. [archive]
- https://www.metzdowd.com/pipermail/cryptography/2014-October/023417.html [archive]
video-entropyd[edit]
- Not in Debian. [archive]
- Do reasons that made randomsound author discourage use of randomsound nowadays [archive] also similarly apply to video-entropyd?
VideoEntropyd is like timer-entropyd for a 'video-4-linux'-compatible device. E.g. a tv-card or a webcam.
TrueRand Based[edit]
clrngd - clock randomness gathering daemon[edit]
- Not in Debian.
- http://freshmeat.sourceforge.net/projects/clrngd [archive]
- https://packages.gentoo.org/packages/sys-apps/clrngd [archive]
- Quote https://www.vanheusden.com/Linux/ [archive]
clrngd.tar.gz - this patch adds code to clrngd so that it will fork itself into the background. This tar-ball also contains a Makefile (the original distribution did not).
clrngd is a daemon which adds entropy to the kernel entropy-driver-buffers which it creates by looking at the differences between several clocks in your workstation/server
- added clrngd.tar.gz to github https://github.com/adrelanos/clrngd [archive] for better publication and easier readability
- licensing issue? BSD license with advertising clause.
- written in C
- writing log output broken for Patrick (might be since that works different nowadays with systemd)
- daemonizes itself (which is also outdated nowadays with systemd)
twuewand - a truerand algorithm for generating entropy[edit]
- https://www.finnie.org/software/twuewand/ [archive]
- https://github.com/rfinnie/twuewand [archive]
- https://www.finnie.org/2011/09/25/introducing-twuewand/ [archive]
- https://www.finnie.org/2012/08/14/twuewand-2-0-released/ [archive]
- https://forums.whonix.org/t/twuewand-a-truerand-algorithm-for-generating-entropy-whonix-integration/8880 [archive]
EGD - The Entropy Gathering Daemon[edit]
- http://egd.sourceforge.net/ [archive]
- Discouraged by its author nowadays.
- https://www.whonix.org/pipermail/whonix-devel/2020-January/001502.html [archive]
- https://www.whonix.org/pipermail/whonix-devel/2020-January/001504.html [archive]
- https://www.whonix.org/pipermail/whonix-devel/2020-January/001505.html [archive]
PRNGD - Pseudo Random Number Generator Daemon[edit]
- http://prngd.sourceforge.net/ [archive]
- http://prngd.sourceforge.net/00README [archive]
- http://prngd.sourceforge.net/00DESIGN [archive]
- https://www.whonix.org/pipermail/whonix-devel/2020-February/001506.html [archive]
- https://www.whonix.org/pipermail/whonix-devel/2020-February/001507.html [archive]
jitter based[edit]
haveged[edit]
Haveged is an entropy gathering daemon.
Quoted from the haveged testing page [archive]: "[...] will behave similarly in a virtual environment is a more risky proposition [...] there have been reports of VM that implement the processor time stamp counter as a constant and there are known differences in cpuid operation in others. [...]"
Will haveged create sufficient entropy in VirtualBox? Luckily, haveged comes with tools to check the if the entropy it creates.
The README in the haveged source folder and the haveged website [archive] contains instructions [archive] for testing haveged.
Makes sense to test entropy while haveged is disabled.
sudo service haveged stop
Get haveged sources and test.
apt source haveged cd haveged-* ./configure --enable-nistest make check ## perhaps repeat #make clean #make check
Should say something like
0 failed individual tests PASS: nist/test.sh ================== All 2 tests passed ==================
- This was successfully tested in VirtualBox without haveged running.
- This was successfully tested in VirtualBox with haveged running.
- This was successfully tested in kvm without rng device and without haveged running.
- This was successfully tested in kvm without rng device and with haveged running.
- This was successfully tested in Qubes without haveged running. [4]
- This was successfully tested in Qubes with haveged running.
Installed by default in Whonix ™.
jitterentropy[edit]
jitterentropy is a RNG designed in the spirit of haveged (using CPU timer jitter as entropy source) except it made up of a kernel module - mainlined since Linux 4.2 and a userspace daemon (jitterentropy-rngd*) to prevent /dev/random from blocking. The advantage of jitterentropy is by taking advantage of a loaded kernel module, it can ensure randomness is being collected before the CSPRNG is initialized. So, when CSPRNG initialization happens, we can ensure that it is properly seeded on first boot, minimizing the likelihood that exact keys will be created on distinct systems. This is something haveged can't provide, as it runs entirely in userspace.
It is a good alternative to haveged, especially for hypervisors that don't support virtio-RNG and so don't have access to entropy sources early during boot process. jitterentropy-rngd is now included in Debian Buster and has been available since Whonix ™ 15.[5][6]
Links:
- https://www.chronox.de/jent.html [archive]
- https://www.chronox.de/jent/doc/CPU-Jitter-NPTRNG.html [archive]
- https://www.chronox.de/jent/doc/CPU-Jitter-NPTRNG.pdf [archive]
- https://pthree.org/2016/05/24/cpu-jitter-entropy-for-the-linux-kernel/ [archive]
- https://packages.debian.org/sid/jitterentropy-rngd [archive]
Playing devil's advocate here: Ted Ts'o [7] expresses strong skepticism about the efficacy of RNGs that rely on CPU jitter. summary: CPU jitter may not be random as thought to someone who designed the CPU cache and know how its internals "tick" [8]. So while these RNGs may not harm, another solution for RNG-less platforms may be a good idea.
It may be that there is some very complex state which is hidden inside the the CPU execution pipeline, the L1 cache, etc., etc. But just because *you* can't figure it out, and just because *I* can't figure it out doesn't mean that it is ipso facto something which a really bright NSA analyst working in Fort Meade can't figure out. (Or heck, a really clever Intel engineer who has full visibility into the internal design of an Intel CPU....)
- https://forums.whonix.org/t/jitterentropy-rngd/7204 [archive]
- Debian bug report: set jitterentropy_rng.ko to built-in [archive]
- ask Xen developers about Efficacy of jitterentropy RNG in Xen [archive]
- Xen-users - Efficacy of jitterentropy RNG in Xen [archive]
- Qemu-devel - Efficacy of jitterentropy RNG on qemu-kvm Guests (asks about Xen too) [archive]
- Qubes feature request: consider installing jitterentropy-rngd to improve entropy collection [archive]
- Answer by jitterentropy developer [archive]
- Efficacy test results for VirtualBox, KVM, Xen [archive]
- https://github.com/smuellerDD/jitterentropy-library/issues/16#issuecomment-939093055 [archive]
kernel module added (Whonix ™ 15.0.0.7.2) and above:
Combining Multiple Jitter Based Entropy Gathering Daemons[edit]
https://github.com/smuellerDD/jitterentropy-library/issues/16 [archive]
Motherboard Integrated[edit]
"such as some Intel/AMD/VIA chipsets"
rng-tools[edit]
Requires a Hardware RNG device. Will result in a failed systemd unit file if none is available. Can be hacked to use it's own entropy pool to gain entropy [archive], but this is probably a bad idea.[9]
Useful nonetheless to install on the host for those who are lucky to have a hardware random device? RDRAND can be found on every AMD64 processor since 2015[10]. Some VIA processors and the Raspberry Pi also have RNG.[11]
rng-tools-debian[edit]
rng-tools5[edit]
Remote Server Based[edit]
- added attack surface
GUChaos[edit]
- http://vladz.devzero.fr/guchaos.html [archive]
- https://www.whonix.org/pipermail/whonix-devel/2020-January/001501.html [archive]
- https://www.whonix.org/pipermail/whonix-devel/2020-February/001510.html [archive]
pollinate[edit]
Linux kernel GCC Plugins[edit]
latent_entropy[edit]
Linux has the latent_entropy GCC plugin to gather more entropy.
Quote https://github.com/torvalds/linux/blob/master/scripts/gcc-plugins/Kconfig [archive]
By saying Y here the kernel will instrument some kernel code to extract some entropy from both original and artificially created program state. This will help especially embedded systems where there is little 'natural' source of entropy normally. The cost is some slowdown of the boot process (about 0.5%) and fork and irq processing. Note that entropy extracted this way is not cryptographically secure!
CONFIG_GCC_PLUGIN_LATENT_ENTROPY
is disabled by default in the Debian kernel but hardened-kernel [archive] enables it.
The linux-hardened [archive] kernel patch improves latent_entropy by adding a extra_latent_entropy
boot parameter [12] which security-misc enables.
Hardware Entropy Keys[edit]
Entropy Key[edit]
Entropy Key [archive]; Hardware not fully open source. Some resources say, it is okay as an additional source of entropy. Where to add it? Since Whonix ™ depends on a host operating system, the Whonix-Gateway ™ and the Whonix-Workstation ™, where it does make most sense to add it? Perhaps adding it to the host and using a entropy broker could be the most effective method. Better than buying three entropy keys.
OneRNG[edit]
OneRNG [archive]; Hardware and Firmware fully open source. Firmware is cryptographically signed to ensure it hasn't been tampered with. Board has a removable tin RF Shield so you can verify the circuits match the diagrams provided by the manufacturer. Fully reprogrammable with manufacturer provided software+cable (must be bought separately). Where to add it? Since Whonix ™ depends on a host operating system, the Whonix-Gateway ™ and the Whonix-Workstation ™, where it does make most sense to add it? Perhaps adding it to the host and using a entropy broker could be the most effective method.
- https://www.metzdowd.com/pipermail/cryptography/2014-December/023948.html [archive]
- https://www.metzdowd.com/pipermail/cryptography/2014-November/023534.html [archive]
List[edit]
- http://noosphere.princeton.edu/reg.html [archive]
- http://en.m.wikipedia.org/wiki/Noosphere [archive]
- http://www.idquantique.com/random-number-generators/products/quantis-usb.html [archive]
- http://onerng.info [archive]
- http://www.entropykey.co.uk [archive]
- https://en.wikipedia.org/wiki/Comparison_of_hardware_random_number_generators [archive]
- http://www.seeedstudio.com/wiki/FST-01 [archive]
- https://packages.debian.org/bullseye/bit-babbler [archive]
- Simtec Electronics Entropy Key - ekeyd - In Debian. [archive]
- https://www.metzdowd.com/pipermail/cryptography/2014-October/023335.html [archive]
- https://www.metzdowd.com/pipermail/cryptography/2014-November/023522.html [archive]
- XR232USB - True Random Number Generator @ USB
- TrueRNG
- Atmel ATSHA204A
rndaddentropy - An RNDADDENTROPY ioctl wrapper[edit]
Software[edit]
$ENTROPY_GENERATOR | rndaddentropy
rndaddentropy
is used to pipe entropy directly into Linux's primary entropy pool. This requires superuser privileges.
Adding entropy directly to the primary entropy pool can be very dangerous, a predictable entropy increases the predictability of resulting data from /dev/random
and /dev/urandom
. Be sure the entropy is generated from a truly random source, and is properly debiased.
- https://github.com/rfinnie/twuewand/tree/master/rndaddentropy [archive]
- https://github.com/rfinnie/twuewand/blob/master/rndaddentropy/Makefile [archive]
- https://github.com/rfinnie/twuewand/blob/master/rndaddentropy/rndaddentropy.c [archive]
- https://github.com/rfinnie/twuewand/blob/master/doc/rndaddentropy.1 [archive]
- https://github.com/rfinnie/twuewand/blob/master/doc/rndaddentropy.md [archive]
Opinion[edit]
Probably not needed and hard to use in a secure way. See #Write to /dev/random and #Credit Entropy.
Debiasing and Whitening[edit]
https://github.com/smuellerDD/jitterentropy-library/issues/16#issuecomment-581901851 [archive]
Early Entropy Issue[edit]
TODO: update
This is described here: https://web.archive.org/web/20191031233802/https://systemd.io/RANDOM_SEEDS.html [archive]
I don't think there's a fragile time window. We're distrusting RDRAND already. Kernel will block /dev/random
until ready and of sufficient quality.
Any new entropy gathering daemons could block booting until systemd sysinit.target
or something even earlier is done.
Whonix ™ / Kicksecure ™ VMs currently also do not have a slow boot issue due to entropy starvation.
VirtualBox Bug Reports[edit]
Entropy Broker[edit]
Entropy Broker is an infrastructure for distributing cryptographically secure random numbers (entropy data) from one or more servers to one or more clients.
Entropy Tests[edit]
ent[edit]
sudo apt install ent
ent file_name
rngtest[edit]
sudo apt install rng-tools5
cat file_name | rngtest
dieharder[edit]
sudo apt install dieharder
dieharder -a -f file_name
PractRand[edit]
http://pracrand.sourceforge.net [archive]
Implementation[edit]
Once we can come up with a design for a new entropy gathering daemon (and perhaps a proof of concept in script language / rapid prototype) 0xsirus [archive] might help to implement the performance critical part in C programming language depending on complexity.
Goal[edit]
Assumption is that any source of randomness could be (sometimes) flawed (weak / predictable / broken / compromised) (in some situations). Such as either in VMs and/or n the host.
Therefore the goal was established to - simplified - "make use of as many sources of entropy as possible".
Ideally, sources of randomness should also be coming from different devices.
CPU is already being used as a source of entropy by haveged and jitterentropy-rng. That's two implementations using the same source using the same device. Adding more entropy generation daemons that are based on CPU - or even worse - based on jitter - is therefore undesirable.
It would be better to tap into other entropy sources such as from noise generated from audio, video, etc. if we can verify these to be good sources of entropy. By implementing that, even if one source of randomness (retrospectively) turns out to be flawed, quality of system entropy should still be excellent.
Resources[edit]
- Gentoo wiki: Generating better random numbers [archive]
- HAVEGE: PolarSSL Security Advisory 2011-02 [archive]
- Qemu: virtio-rng, virtual random generator [archive]
- Random Sequence Generator based on Avalanche Noise [archive]
- https://groups.google.com/forum/#!forum/randomness-generation [archive]
- https://groups.google.com/forum/#!topic/randomness-generation/pIdFa3iarhI [archive]
- On Linux entropy issues generally. Must read. - https://www.av8n.com/computer/htm/secure-random.htm [archive]
- systemd Random Seeds [archive]
- https://wiki.debian.org/Entropy [archive]
- https://www.phoronix.com/scan.php?page=news_item&px=Linux-5.4-Actively-Gen-Entropy [archive]
- https://volumeintegration.com/best-entropy-generation-software-for-linux/ [archive]
- https://www.bsi.bund.de/SharedDocs/Downloads/EN/BSI/Publications/Studies/LinuxRNG/LinuxRNG_EN.pdf [archive]
- https://www.bsi.bund.de/SharedDocs/Downloads/DE/BSI/Publikationen/Studien/ZufallinVMS/Randomness-in-VMs.pdf [archive]
- http://www.av8n.com/computer/htm/fixup-live-cd.htm [archive]
- https://lwn.net/Articles/525459/ [archive]
- https://daniel-lange.com/archives/152-hello-buster.html [archive]
Comics[edit]
Footnotes[edit]
- ↑ Peter Gutmann of secure erasure fame https://www.metzdowd.com/pipermail/cryptography/2019-September/035329.html [archive]
- ↑
The following viewpoint "/dev/random is obsolete" has been deprecated.
This debate comes from a misconception by the Linux manual writer.
https://pthree.org/2014/07/21/the-linux-random-number-generator/ [archive]
The fact is both APIs use the same CSPRNG. The issue happens when the randomness pool has not been properly initialized and entropy is requested early at boot. Otherwise the blocking behavior of
/dev/random
during normal system running is an annoying bug than a useful safety feature. A well seeded pool should be able to provide sufficient/endless randomness from a single seed.https://news.ycombinator.com/item?id=11561340 [archive] Comments by tptacek
https://www.2uo.de/myths-about-urandom [archive]
There is no concept of entropy being used up when urandom is used unlike random that nonsensically calculates left over entropy and blocks despite a healthily initialized pool.
https://unix.stackexchange.com/questions/94206/how-to-determine-which-processes-are-using-how-much-entropy-from-dev-urandom [archive]Therefore rate limiting virtio-rng is unnecessary when using urandom as a backend.
Here is what renown cryptographer Dr. Daniel J. Bernstein has to say on the matter:
http://www.mail-archive.com/cryptography@randombit.net/msg04763.html [archive]
Cryptographers are certainly not responsible for this superstitious nonsense. Think about this for a moment: whoever wrote the /dev/random manual page seems to simultaneously believe that
(1) we can't figure out how to deterministically expand one 256-bit /dev/random output into an endless stream of unpredictable keys (this is what we need from urandom), but
(2) we _can_ figure out how to use a single key to safely encrypt many messages (this is what we need from SSL, PGP, etc.).
For a cryptographer this doesn't even pass the laugh test.
I'm not saying that /dev/urandom has a perfect API. It's disappointingly common for vendors to deploy devices where the randomness pool has never been initialized; BSD /dev/urandom catches this configuration bug by blocking, but Linux /dev/urandom (unlike Linux /dev/random) spews predictable data, causing (e.g.) the widespread RSA security failures documented on http://factorable.net [archive]. But fixing this configuration bug has nothing to do with the /dev/random superstitions.
- ↑ http://www.mail-archive.com/cryptography@randombit.net/msg04763.html [archive]
- ↑ https://phabricator.whonix.org/T32 [archive]
- ↑ https://phabricator.whonix.org/T817 [archive]
- ↑ https://phabricator.whonix.org/T727 [archive]
- ↑ He's the main developer behind Linux's RNG and staunchly resisted relying only on Intel's RDRAND. His opinions carry weight with good reason.
- ↑ https://lwn.net/Articles/586427/ [archive]
- ↑
Setting up rng-tools (2-unofficial-mt.14-1+b2) ... Job for rng-tools.service failed because the control process exited with error code. See "systemctl status rng-tools.service" and "journalctl -xe" for details. invoke-rc.d: initscript rng-tools, action "start" failed. \u25cf rng-tools.service Loaded: loaded (/etc/init.d/rng-tools; generated) Active: failed (Result: exit-code) since Fri 2020-01-31 10:56:20 UTC; 7ms ago Docs: man:systemd-sysv-generator(8) Process: 32118 ExecStart=/etc/init.d/rng-tools start (code=exited, status=1/FAILURE) Jan 31 10:56:20 host systemd[1]: Starting rng-tools.service... Jan 31 10:56:20 host rng-tools[32118]: Starting Hardware RNG entropy gatherer daemon: (Hardware RNG device inode not found) Jan 31 10:56:20 host rng-tools[32118]: /etc/init.d/rng-tools: Cannot find a hardware RNG device to use. Jan 31 10:56:20 host systemd[1]: rng-tools.service: Control process exited, code=exited, status=1/FAILURE Jan 31 10:56:20 host systemd[1]: rng-tools.service: Failed with result 'exit-code'. Jan 31 10:56:20 host systemd[1]: Failed to start rng-tools.service.
- ↑ http://support.amd.com/TechDocs/24594.pdf [archive]
- ↑ https://wiki.archlinux.org/index.php/Rng-tools [archive]
- ↑ https://github.com/anthraxx/linux-hardened/commit/0ca98c2ffe1ee5b4580c4d2aa797bc793164fc94 [archive]
Whonix ™ is Supported by Evolution Host DDoS Protected VPS. Stay private and get your VPS with Bitcoin or Monero.
100px | |
Fosshost | About Advertisements |
Search engines: YaCy | Qwant | ecosia | MetaGer | peekier | Whonix ™ Wiki
Please help in testing new features and bug fixes in Whonix ™.
Priority Support | Investors | Professional Support
Whonix ™ | © ENCRYPTED SUPPORT LP | Freedom Software / Open Source (Why?)
The personal opinions of moderators or contributors to the Whonix ™ project do not represent the project as a whole.