{"id":4487,"date":"2023-09-21T13:57:13","date_gmt":"2023-09-21T17:57:13","guid":{"rendered":"https:\/\/blog.daed.com\/?p=4487"},"modified":"2024-07-11T10:59:20","modified_gmt":"2024-07-11T14:59:20","slug":"the-current-reality-of-low-cost-sensors-scientific-data-actionable-data-and-lies","status":"publish","type":"post","link":"https:\/\/blog.daed.com\/?p=4487","title":{"rendered":"The Current Reality of Low-Cost Sensors: Scientific Data, Actionable Data, and Lies"},"content":{"rendered":"

\"Cityscape<\/a><\/span><\/p>\n

The rise of low-cost sensors, like MEMS, optical, piezoelectric, chemical, and others, has made it possible to integrate sensing into everyday devices. These sensors, which once required bulky laboratory equipment, can now be found in commonplace objects like phones, watches, and even toasters. With the connectivity of these devices and widespread networking, a vast amount of data can be gathered and used.<\/span><\/p>\n

The problem is that while it\u2019s tempting to assume that your sensor is measuring what you want it to measure, that is so far from the truth that \u201call sensors lie\u201d has become a common refrain among engineers. Measuring what you want to measure in a specific application requires a significant amount of filtering, analysis, and calibration to compensate for confounding factors, and even combining data from multiple sensors (sensor fusion) for accurate measurements. Successfully using sensors in any application involves a lot of trial and error.\u00a0<\/span><\/p>\n

Over the past decade, sensor companies have been adding \u201csmarts\u201d to their products by embedding some of the algorithms that previously required external software. While this is good in many cases, sometimes this hidden and undocumented processing can reduce accuracy. This is especially true for sensors that measure dynamic signals where sampling frequency and bandwidth are important.\u00a0<\/span><\/p>\n

Don\u2019t get me wrong \u2026 it\u2019s remarkable what tiny MEMS and other low-cost sensors are capable of, but they aren\u2019t accurate enough for certain applications. Let\u2019s look at why.\u00a0<\/span><\/p>\n

Good Enough Versus Laboratory-Grade Sensors<\/h2>\n

First, let\u2019s look at the differences between your phone\u2019s 32\u00a2<\/strong> motion sensor and the $4,000 accelerometer used in laboratory equipment. If you delve into the specifications, you\u2019ll see significant differences in variables like sensitivity, resolution, accuracy, repeatability, signal-to-noise ratio, bandwidth, stability, drift, response time, ruggedness, environmental range, and calibration. All of these affect the measurements taken.\u00a0<\/span><\/p>\n

Aside from those differences, the $4,000 sensors also have NIST traceability<\/em>. Most measurements taken for scientific purposes are required to be done with instruments that can be traced to defined standards. This assures that when the sensor measures a variable at X level, that reading is accurate. In the U.S., the standards body is the National Institute of Standards and Technology (NIST). NIST defines the measurement standard, and they often define appropriate approaches for calibrating sensors against that standard.\u00a0<\/span><\/p>\n

To ensure that measurements taken by scientific and medical equipment continue to be highly accurate, the equipment is calibrated against the reference standard regularly. Calibration can be very involved; an entire industry has developed around calibrating equipment. That kind of rigor is costly.\u00a0<\/span><\/p>\n

However, NIST traceability isn\u2019t necessary for most everyday sensing. If the accelerometer in your watch misses a few steps, would you even notice? Low-cost sensors are good enough for low-stakes everyday applications. Where we run into issues is when low-cost sensors are used for applications where they are unable to measure accurately enough under all conditions\u2014when they are no longer good enough.\u00a0<\/span><\/p>\n

Air quality monitoring is one area where low-cost sensors can result in large errors. For example, the popular PurpleAir sensor is <\/span>well-documented<\/a> as poorly calibrated and unable to compensate well for humidity. It also has poor particle size selectivity and is prone to large errors due to age and exposure. So, while the large network of PurpleAir monitors around the world does provide meaningful insight into general particulate levels in different areas\u2014which we\u2019ll get to in a moment\u2014these measurements should not be trusted for critical decisions and any single measurement is not reliably meaningful.<\/span>\u00a0<\/span><\/p>\n

Measured Versus Inferred Data<\/h2>\n

Things get more complicated when low-cost sensors are used with algorithms to provide information that they aren\u2019t actually measuring. At best, the measurements are correlated,<\/em> and at worst, they are inferred<\/em> by the sensor data.\u00a0<\/span><\/p>\n

Respiration rate measured by smartwatches is one example. It is derived from the watch\u2019s Photoplethysmography (PPG) signals, which detect other physiological parameters related to blood flow, like heart rate and oxygen saturation (Sp02<\/sub>). Respiration rates can be<\/span> estimated<\/em><\/a> from this data, but not measured<\/em>.\u00a0<\/span><\/span><\/p>\n

Worse are \u201cCO2<\/sub> equivalence levels\u201d derived by some volatile organic compound (VOC) sensors. CO2<\/sub> equivalence is a way of expressing the potential environmental impact of detected VOCs in terms of equivalent CO2<\/sub> emissions (i.e., this level of VOCs is as bad for global warming as this much CO2<\/sub> would be). But VOC sensors don’t measure CO2<\/sub>, rather they use assumptions about the gas being detected and algorithms with questionable math to infer<\/em> what the equivalent CO2<\/sub> level would be if the assumptions are accurate.\u00a0<\/span><\/p>\n

While there may be strong practical correlations, the use of AI algorithms to infer something that isn\u2019t directly related to what the device is sensing is dubious. Consider devices that claim to non-invasively measure blood glucose by optical, thermal, or other sensor techniques. There are observable correlations between blood glucose levels and many measurements that sensors can provide, but there is currently no accurate<\/em> and reliable<\/em> method to quantitatively measure blood glucose using non-invasive techniques. The consequences of putting too much trust in one of these sensors could literally be deadly.<\/span><\/p>\n

Data Versus Meaning<\/h2>\n

Once you have your data, using that data in a meaningful way is the next challenge when working with low-cost sensors.\u00a0<\/span><\/p>\n

Beyond accurate data, there are challenges in interpretation to determine the best course of action to take. Fall detection is a good example: if you can sense the direction, acceleration, and rotation of a person in real-time with good accuracy, then you might think that you can detect a fall\u2014maybe even early enough to do something to prevent injury. Imagine if your phone interpreted a sudden drop as a fall and automatically dialed 911\u2014when in reality, you\u2019d just dropped your phone. While this feature is common on phones and smart watches now, it is wrong far more often than it is right. Confirmation and delay of action are required to avoid false alarms, and both are actively being used to \u201ctrain\u201d the detection algorithms.<\/span><\/p>\n

Real life in the real world is complicated and the consequences of false or missed activations are serious enough that it\u2019s generally not feasible to determine the best course of action based on sensor data alone. Drawing that line is critical. Understanding all of the factors involved in making that decision\u2014in the few milliseconds available\u2014is the real design and engineering challenge. AI algorithms are being developed and trained to interpret sensor data because we just don\u2019t have analytical approaches that work well enough.<\/span><\/p>\n

Measuring something as simple as the temperature can be<\/span> surprisingly challenging<\/a>. While you can<\/em> accurately measure the temperature of the sensor itself, more than likely you are interested in measuring air temperature or the temperature of some other specific point. The sensor is likely not exclusively influenced by the target point: heating from the circuit board, motors, batteries, and even the user\u2019s body are common problems that make measuring temperature challenging.\u00a0<\/span><\/span><\/p>\n

There are a few exceptions. Front airbags use sensors to detect when to deploy, reducing the occupant\u2019s impact in life-threatening crashes. They generally do not deploy for fender-benders, where the risk of injury from airbag deployment outweighs the risk of injuries from the impact. However, side impact airbags are an exception to that exception. They are supposed to deploy only in rollover situations, but they have<\/span> deployed on bumpy roads<\/a> under normal driving conditions\u2014and this still occurs, rarely, after years<\/em> of development and testing.\u00a0<\/span><\/span><\/p>\n

Seeing the Big (Data) Picture<\/h2>\n

While low-cost sensors may not be highly accurate and they\u2019re certainly not calibrated to the reference standards necessary for critical measurements, they don\u2019t really need to be for most applications. When those applications are looking at big-picture data rather than basing actions on single measurements, they are good enough. The Apple Watch might not count every step you take, but it\u2019s correct within 1-2% for most people, which is good enough. While day-to-day measurements in the Apple Health app likely contain too much noise to be individually reliable, looking at how that data trends over longer time periods provides useful insights.<\/span><\/p>\n

Similarly, a large quantity of low-cost air quality sensors do provide meaningful data, even when the sensors themselves have limited individual accuracy. On a geographic scale, the tens of thousands of deployed low-cost air quality monitors provide useful information on the air quality around the world. Those measurements\u2014collected over time, over wide geographic spaces, and over thousands of units\u2014can be transformed from imprecise data points into a meaningful and useful picture.<\/span><\/p>\n

Sensors Use at Daedalus<\/h2>\n

Using sensors, even under simple circumstances, comes with a surprising number of challenges. When things get complex, the challenge of using sensors increases exponentially.\u00a0<\/span><\/p>\n

At Daedalus, we specialize in those challenging situations. We\u2019ve developed a process that helps us to identify the best sensor for the application, and we\u2019ve learned to rely on multiple sensors, using diverse technologies, and in different locations to ensure more accurate and reliable results, particularly when avoiding errors is critically important. We\u2019ve used sensors to ensure<\/span> fall safety compliance<\/a>,<\/span> pinpoint missing surgical sponges<\/a>,<\/span> detect drugs in the U.S. mail<\/a>,<\/span> locate underground pipes<\/a>,<\/span> non-invasively detect bilirubin<\/a>, and to help ensure the safety of industrial workers from exposure to excessive<\/span> noise<\/a>,<\/span> dust<\/a>, and<\/span> hazardous gases<\/a>.<\/span><\/span><\/p>\n","protected":false},"excerpt":{"rendered":"

The rise of low-cost sensors, like MEMS, optical, piezoelectric, chemical, and others, has made it possible to integrate sensing into everyday devices. These sensors, which once required bulky laboratory equipment, …<\/p>\n","protected":false},"author":10,"featured_media":4489,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[220,218,219],"class_list":["post-4487","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-product-development","tag-automation","tag-low-cost-sensors","tag-sensors"],"yoast_head":"\nThe Current Reality of Low-Cost Sensors: Scientific Data, Actionable Data, and Lies - daed.com<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blog.daed.com\/?p=4487\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Current Reality of Low-Cost Sensors: Scientific Data, Actionable Data, and Lies - daed.com\" \/>\n<meta property=\"og:description\" content=\"The rise of low-cost sensors, like MEMS, optical, piezoelectric, chemical, and others, has made it possible to integrate sensing into everyday devices. These sensors, which once required bulky laboratory equipment, ...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blog.daed.com\/?p=4487\" \/>\n<meta property=\"og:site_name\" content=\"daed.com\" \/>\n<meta property=\"article:published_time\" content=\"2023-09-21T17:57:13+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-07-11T14:59:20+00:00\" \/>\n<meta property=\"og:image\" content=\"http:\/\/blog.daed.com\/wp-content\/uploads\/2023\/09\/shutterstock_1794958636-copy2.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"2000\" \/>\n\t<meta property=\"og:image:height\" content=\"958\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Daedalus Team\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Daedalus Team\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"7 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/blog.daed.com\/?p=4487#article\",\"isPartOf\":{\"@id\":\"https:\/\/blog.daed.com\/?p=4487\"},\"author\":{\"name\":\"Daedalus Team\",\"@id\":\"https:\/\/blog.daed.com\/#\/schema\/person\/f08aac4ae63cbed0fffa61088919d15f\"},\"headline\":\"The Current Reality of Low-Cost Sensors: Scientific Data, Actionable Data, and Lies\",\"datePublished\":\"2023-09-21T17:57:13+00:00\",\"dateModified\":\"2024-07-11T14:59:20+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/blog.daed.com\/?p=4487\"},\"wordCount\":1562,\"publisher\":{\"@id\":\"https:\/\/blog.daed.com\/#organization\"},\"keywords\":[\"Automation\",\"Low-Cost Sensors\",\"Sensors\"],\"articleSection\":[\"product development\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blog.daed.com\/?p=4487\",\"url\":\"https:\/\/blog.daed.com\/?p=4487\",\"name\":\"The Current Reality of Low-Cost Sensors: Scientific Data, Actionable Data, and Lies - daed.com\",\"isPartOf\":{\"@id\":\"https:\/\/blog.daed.com\/#website\"},\"datePublished\":\"2023-09-21T17:57:13+00:00\",\"dateModified\":\"2024-07-11T14:59:20+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/blog.daed.com\/?p=4487#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blog.daed.com\/?p=4487\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blog.daed.com\/?p=4487#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blog.daed.com\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"The Current Reality of Low-Cost Sensors: Scientific Data, Actionable Data, and Lies\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blog.daed.com\/#website\",\"url\":\"https:\/\/blog.daed.com\/\",\"name\":\"daed.com\",\"description\":\"research, design, and engineering thinking\",\"publisher\":{\"@id\":\"https:\/\/blog.daed.com\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blog.daed.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/blog.daed.com\/#organization\",\"name\":\"daed.com\",\"url\":\"https:\/\/blog.daed.com\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.daed.com\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/blog.daed.com\/wp-content\/uploads\/2019\/10\/White_Daedalus.png\",\"contentUrl\":\"https:\/\/blog.daed.com\/wp-content\/uploads\/2019\/10\/White_Daedalus.png\",\"width\":5249,\"height\":745,\"caption\":\"daed.com\"},\"image\":{\"@id\":\"https:\/\/blog.daed.com\/#\/schema\/logo\/image\/\"}},{\"@type\":\"Person\",\"@id\":\"https:\/\/blog.daed.com\/#\/schema\/person\/f08aac4ae63cbed0fffa61088919d15f\",\"name\":\"Daedalus Team\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blog.daed.com\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/5d6de936556c9bdce42cd8b08658caf153a45451b66de4cda47d7ee8a3aaeb83?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/5d6de936556c9bdce42cd8b08658caf153a45451b66de4cda47d7ee8a3aaeb83?s=96&d=mm&r=g\",\"caption\":\"Daedalus Team\"},\"sameAs\":[\"http:\/\/www.daed.com\"],\"url\":\"https:\/\/blog.daed.com\/?author=10\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Current Reality of Low-Cost Sensors: Scientific Data, Actionable Data, and Lies - daed.com","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blog.daed.com\/?p=4487","og_locale":"en_US","og_type":"article","og_title":"The Current Reality of Low-Cost Sensors: Scientific Data, Actionable Data, and Lies - daed.com","og_description":"The rise of low-cost sensors, like MEMS, optical, piezoelectric, chemical, and others, has made it possible to integrate sensing into everyday devices. These sensors, which once required bulky laboratory equipment, ...","og_url":"https:\/\/blog.daed.com\/?p=4487","og_site_name":"daed.com","article_published_time":"2023-09-21T17:57:13+00:00","article_modified_time":"2024-07-11T14:59:20+00:00","og_image":[{"width":2000,"height":958,"url":"http:\/\/blog.daed.com\/wp-content\/uploads\/2023\/09\/shutterstock_1794958636-copy2.jpg","type":"image\/jpeg"}],"author":"Daedalus Team","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Daedalus Team","Est. reading time":"7 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blog.daed.com\/?p=4487#article","isPartOf":{"@id":"https:\/\/blog.daed.com\/?p=4487"},"author":{"name":"Daedalus Team","@id":"https:\/\/blog.daed.com\/#\/schema\/person\/f08aac4ae63cbed0fffa61088919d15f"},"headline":"The Current Reality of Low-Cost Sensors: Scientific Data, Actionable Data, and Lies","datePublished":"2023-09-21T17:57:13+00:00","dateModified":"2024-07-11T14:59:20+00:00","mainEntityOfPage":{"@id":"https:\/\/blog.daed.com\/?p=4487"},"wordCount":1562,"publisher":{"@id":"https:\/\/blog.daed.com\/#organization"},"keywords":["Automation","Low-Cost Sensors","Sensors"],"articleSection":["product development"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/blog.daed.com\/?p=4487","url":"https:\/\/blog.daed.com\/?p=4487","name":"The Current Reality of Low-Cost Sensors: Scientific Data, Actionable Data, and Lies - daed.com","isPartOf":{"@id":"https:\/\/blog.daed.com\/#website"},"datePublished":"2023-09-21T17:57:13+00:00","dateModified":"2024-07-11T14:59:20+00:00","breadcrumb":{"@id":"https:\/\/blog.daed.com\/?p=4487#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blog.daed.com\/?p=4487"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/blog.daed.com\/?p=4487#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blog.daed.com\/"},{"@type":"ListItem","position":2,"name":"The Current Reality of Low-Cost Sensors: Scientific Data, Actionable Data, and Lies"}]},{"@type":"WebSite","@id":"https:\/\/blog.daed.com\/#website","url":"https:\/\/blog.daed.com\/","name":"daed.com","description":"research, design, and engineering thinking","publisher":{"@id":"https:\/\/blog.daed.com\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blog.daed.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/blog.daed.com\/#organization","name":"daed.com","url":"https:\/\/blog.daed.com\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.daed.com\/#\/schema\/logo\/image\/","url":"https:\/\/blog.daed.com\/wp-content\/uploads\/2019\/10\/White_Daedalus.png","contentUrl":"https:\/\/blog.daed.com\/wp-content\/uploads\/2019\/10\/White_Daedalus.png","width":5249,"height":745,"caption":"daed.com"},"image":{"@id":"https:\/\/blog.daed.com\/#\/schema\/logo\/image\/"}},{"@type":"Person","@id":"https:\/\/blog.daed.com\/#\/schema\/person\/f08aac4ae63cbed0fffa61088919d15f","name":"Daedalus Team","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blog.daed.com\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/5d6de936556c9bdce42cd8b08658caf153a45451b66de4cda47d7ee8a3aaeb83?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/5d6de936556c9bdce42cd8b08658caf153a45451b66de4cda47d7ee8a3aaeb83?s=96&d=mm&r=g","caption":"Daedalus Team"},"sameAs":["http:\/\/www.daed.com"],"url":"https:\/\/blog.daed.com\/?author=10"}]}},"_links":{"self":[{"href":"https:\/\/blog.daed.com\/index.php?rest_route=\/wp\/v2\/posts\/4487","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.daed.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.daed.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.daed.com\/index.php?rest_route=\/wp\/v2\/users\/10"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.daed.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4487"}],"version-history":[{"count":4,"href":"https:\/\/blog.daed.com\/index.php?rest_route=\/wp\/v2\/posts\/4487\/revisions"}],"predecessor-version":[{"id":4628,"href":"https:\/\/blog.daed.com\/index.php?rest_route=\/wp\/v2\/posts\/4487\/revisions\/4628"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.daed.com\/index.php?rest_route=\/wp\/v2\/media\/4489"}],"wp:attachment":[{"href":"https:\/\/blog.daed.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4487"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.daed.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4487"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.daed.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4487"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}