{"id":4151,"date":"2023-07-21T15:01:00","date_gmt":"2023-07-21T13:01:00","guid":{"rendered":"https:\/\/innovatrics.com\/trustreport\/?p=4151"},"modified":"2023-08-09T11:21:36","modified_gmt":"2023-08-09T09:21:36","slug":"the-magic-of-synthetic-data","status":"publish","type":"post","link":"https:\/\/innovatrics.com\/trustreport\/the-magic-of-synthetic-data\/","title":{"rendered":"The magic of synthetic data: How nonexistent fingerprints help identify real criminals"},"content":{"rendered":"\n
\"\"<\/figure>\n\n\n\n
\n
\n
\n\n\n\n

Contributors<\/h4>\n\n\n
\n \"\"\n
\n

Igor J\u00e1no\u0161<\/strong>
\nImage data synthesis
\nlead at Innovatrics<\/p>\n <\/div>\n<\/div><\/div>\n\n\n\n

\n

To train a viable AI model, you need data. Lots of it. But what do you do if there just isn’t enough? Simple: you make some up. Or, to put it in fancier terms, you \u201cgenerate synthetic data\u201d. <\/strong><\/p>\n<\/div>\n<\/div>\n\n\n\n

\n
<\/div>\n\n\n\n
\n

Igor J\u00e1no\u0161, image data synthesis lead at Innovatrics, explains why the world is in need of more data than we currently generate, and how creating synthetic data can not only help to catch criminals but also to safely train the self-driving cars of the future.<\/p>\n\n\n\n

What is synthetic data and why is it useful?<\/h2>\n\n\n\n

Synthetic data is an artificially generated dataset that can be modelled to look like a real dataset or be deliberately skewed to exaggerate an important aspect.<\/p>\n\n\n\n

Let\u2019s say you are developing an AI to identify problematic roads in a city. You spend an enormous amount of money and time recording hundreds of hours of footage from thousands of roads, and use that to train your AI to find problematic aspects of roads. However, that takes a lot of time, effort and expense.<\/p>\n\n\n\n

For the computer, each road is just a set of numbers anyway: one might represent the position of the road, another might represent its length, the time of day or the number of cars driving through it. So why spend your time recording, when you can just randomly scramble the variables and generate thousands of possible road variations on the spot? <\/p>\n\n\n

\n
\n
\n \"\"\n\n <\/div>\n
\n
\n Read more<\/a>\n

\n \n We collect and analyse fingerprints to better understand the needs of law enforcement <\/a>\n <\/h2>\n <\/div>\n\n\n <\/div>\n <\/div>\n<\/div>\n\n\n\n

As long as you make sure your artificial roads have parameters similar to real-world roads (similar lengths, traffic density, etc.) and similar distributions (i.e. every city has a myriad of smaller streets and far fewer main highways, and this should be similarly represented in the data), AI will not see the difference.<\/p>\n\n\n\n

That is one of the biggest upsides of synthetic data \u2013 it\u2019s cheap, fast and, as we will see, it can be a good way to get around personal data restrictions.<\/p>\n\n\n\n

Of course, there are also downsides. Synthetic data is good for \u201cfilling in the curve\u201d of the standard distribution, but will seldom increase the complexity, introduce new edge cases, or reflect any real-world outliers. And most importantly, it\u2019s only ever as good as the real-world data you feed in.<\/p>\n<\/div>\n<\/div>\n\n\n\n

\n
<\/div>\n\n\n\n
\n

One can never have enough fingerprints<\/h2>\n\n\n\n

Did you know that fingerprints are a scarce resource? When it comes to a criminal investigation, certain types of fingerprints are rare \u2013 and therefore so valuable that, for Igor J\u00e1no\u0161, it’s worth creating and training AI models with the sole purpose of creating synthetic fingerprints.<\/p>\n\n\n\n

The most readily available types of fingerprints are scanned. Pushing your whole finger on a scanner surface, you take a clean black-and-white scan of your full fingerprint pattern. This makes it very easy to identify the distinctive features of the fingerprint \u2013 called \u201cminutiae points\u201d \u2013 such as ridge endings, bifurcations or spurs.<\/p>\n\n\n\n

\u201cWith databases full of millions of clear fingerprints, all similarly sized and clearly labelled, it’s possible to easily train a neural network to search for patterns. In these cases it can recognise and identify your print in a fraction of a second by comparing it to the fingerprints in the database,\u201d<\/em> explained Igor J\u00e1no\u0161.<\/p>\n\n\n\n

\"\"<\/figure>\n<\/div>\n<\/div>\n\n\n\n
\n
<\/div>\n\n\n\n
\n

However, in criminal investigations things are not that easy. You are mostly dealing with latent fingerprints \u2013 damaged or distorted remnants of an original fingerprint, which are also only photographed, not scanned. That means each print is likely to have a different size and rotation (as the photos are taken when at the crime scene), to have been shot from a different angle, and have different backgrounds or lens relics.<\/p>\n\n\n\n

In addition, if this lack of homogeneous data is not enough, there is also a problem with data privacy. \u201cThe fingerprints are still protected under GDPR as personal data, and of course no police department will open their archives for you just to train your algorithm,\u201d <\/em>explains J\u00e1no\u0161.<\/p>\n\n\n\n

There is just one certified, publicly accessible dataset of 10,000 pictures of latent fingerprints. And it only contains prints of 250 distinct individuals.<\/p>\n\n\n\n

\"\"<\/figure>\n<\/div>\n<\/div>\n\n\n\n
\n
<\/div>\n\n\n\n
\n

So, between the lack of material from which to train, and the lack of variety in the data that does exist, is there a way to improve the identification of fingerprints \u201cin the wild\u201d via an algorithm? Yes, by generating synthetic ones.<\/p>\n\n\n\n

Generating synthetic fingerprints? It\u2019s harder than you think<\/h2>\n\n\n\n

You will almost certainly have heard of image generators like DALL-E or Stable Diffusion. Well, what if, instead of generating random images, you trained the generator to create \u2026 synthetic fingerprints?<\/p>\n\n\n\n

It\u2019s hard, but it is possible.<\/p>\n\n\n\n

There is plenty of training data from scanned fingerprint images, but the way in which image generation works makes it hard to generate pictures without gradual colour transitions. And fingerprints are the definition of having no transition \u2013 they\u2019re just clear-cut black-and-white lines.<\/p>\n\n\n\n

\"\"<\/figure>\n<\/div>\n<\/div>\n\n\n\n
\n
\n
\n\n\n\n

Learn more about the pitfalls of fingerprint generating from Igor J\u00e1no\u0161\u2019s talk at the Better AI Meetup<\/p>\n\n\n\n

\n
Wach the talk<\/a><\/div>\n<\/div>\n<\/div>\n\n\n\n
\n

However, after hours of training, you can get a model to generate oval shaped fingerprints with distinct minutiae points \u2013 structures, bifurcations and spurs. And you are half way there!<\/p>\n\n\n\n

\"\"<\/figure>\n<\/div>\n<\/div>\n\n\n\n
\n
<\/div>\n\n\n\n
\n

Now comes the other difficult part \u2013 making the fingerprints \u201clatent\u201d, in other words, damaged or incomplete. This is done by introducing the real, very limited set of latent fingerprints from an existing database. You need to carefully nudge the algorithm in the right direction by building layer upon layer of distortion \u2013 clippings, smudges, deleting parts of the image \u2013 all while keeping the important minutiae points intact.<\/p>\n\n\n\n

Igor J\u00e1no\u0161 concludes: \u201cThe result, after days of training and weeks of research time, is a highly realistic, but importantly \u2018not\u2019 real, latent fingerprint.\u201d<\/em><\/p>\n<\/div>\n<\/div>\n\n\n\n

\n
\n
\n\n\n\n

Investigators around the globe use it right now<\/strong><\/p>\n\n\n\n

ABIS (automated biometric identification system) by Innovatrics is already deployed in one of the largest biometric criminal investigation systems<\/a> in the world.<\/p>\n\n\n\n

Used to identify fingerprints, faces or irises, it\u2019s able to find matches from millions of database entries in a fraction of a second.<\/p>\n<\/div>\n\n\n\n

\n

What to do with synthetic data? Teach your neural network<\/h2>\n\n\n\n

Once you have generated high-quality synthetic data, you can use it to train other networks that do the actual work you need. This might be the recognition and pairing of latent fingerprints with their scanned counterparts, as in the research of Igor J\u00e1no\u0161, or matching mugshots from police databases with the partial face images from CCTV cameras.<\/p>\n\n\n\n

Outside of the justice system, synthetic data is used daily. For example, it\u2019s used to improve the statistical models of insurance companies, or to help identify fraudulent payments by modelling customer behaviours for banks. It even makes sensitive health-related data publicly accessible by generating synthetic data modelled on real patients without breaching their confidentiality.<\/p>\n\n\n\n

One of the more \u201dfuturistic\u201d uses of synthetic data is the training of self-driving cars. Instead of allowing self-driving vehicles to train on the road, the majority of the training is done on vast 3D-simulations of roads, intersections and entire cities. A neural network is let loose inside these simulated situations and can get years of driving experience in a matter of weeks or months.  <\/p>\n\n\n\n

The data of the future is synthetic<\/h2>\n\n\n\n

In a world where machine learning is used in more applications every minute, synthetic data is quickly rising to prominence. It will improve big models and allow us to create new applications we\u2019d previously never thought possible. What is now a tiny market of $169 million is forecasted to grow to $3.5 billion by 2031.<\/p>\n\n\n\n

And it has the potential to make our world not just better, but safer for all.<\/p>\n<\/div>\n<\/div>\n\n\n\n

\n\n\n\n

AUTHOR<\/strong>: Andrej Kras<\/p>\n","protected":false},"excerpt":{"rendered":"

To train a viable AI model, you need data. Lots of it. But what do you do if there just isn’t enough? Simple: you make some up. Or, to put it in fancier terms, you \u201cgenerate synthetic data\u201d. <\/p>\n","protected":false},"author":6,"featured_media":5415,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":[],"categories":[1],"tags":[66,59,32],"yoast_head":"\nThe magic of synthetic data: How nonexistent fingerprints help identify real criminals - Innovatrics<\/title>\n<meta name=\"description\" content=\"To train a viable AI model, you need data. Lots of it. But what do you do if there just isn't enough? Simple: you make some up. Or, to put it in fancier terms, you \u201cgenerate synthetic data\u201d.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/innovatrics.com\/trustreport\/the-magic-of-synthetic-data\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The magic of synthetic data: How nonexistent fingerprints help identify real criminals - Innovatrics\" \/>\n<meta property=\"og:description\" content=\"To train a viable AI model, you need data. Lots of it. But what do you do if there just isn't enough? Simple: you make some up. Or, to put it in fancier terms, you \u201cgenerate synthetic data\u201d.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/innovatrics.com\/trustreport\/the-magic-of-synthetic-data\/\" \/>\n<meta property=\"og:site_name\" content=\"Innovatrics\" \/>\n<meta property=\"article:published_time\" content=\"2023-07-21T13:01:00+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-08-09T09:21:36+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/innovatrics.com\/trustreport\/wp-content\/uploads\/2023\/07\/OG-image.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"631\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\">\n\t<meta name=\"twitter:data1\" content=\"7 minutes\">\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebSite\",\"@id\":\"https:\/\/innovatrics.com\/trustreport\/#website\",\"url\":\"https:\/\/innovatrics.com\/trustreport\/\",\"name\":\"Innovatrics\",\"description\":\"Len \\u010fal\\u0161ia WordPress str\\u00e1nka\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":\"https:\/\/innovatrics.com\/trustreport\/?s={search_term_string}\",\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/innovatrics.com\/trustreport\/the-magic-of-synthetic-data\/#primaryimage\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/innovatrics.com\/trustreport\/wp-content\/uploads\/2023\/07\/cover-synthetic-data.png\",\"width\":3000,\"height\":1600},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/innovatrics.com\/trustreport\/the-magic-of-synthetic-data\/#webpage\",\"url\":\"https:\/\/innovatrics.com\/trustreport\/the-magic-of-synthetic-data\/\",\"name\":\"The magic of synthetic data: How nonexistent fingerprints help identify real criminals - Innovatrics\",\"isPartOf\":{\"@id\":\"https:\/\/innovatrics.com\/trustreport\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/innovatrics.com\/trustreport\/the-magic-of-synthetic-data\/#primaryimage\"},\"datePublished\":\"2023-07-21T13:01:00+00:00\",\"dateModified\":\"2023-08-09T09:21:36+00:00\",\"author\":{\"@id\":\"https:\/\/innovatrics.com\/trustreport\/#\/schema\/person\/aa8ac119593dd2e3e7e0e0fe172a40fc\"},\"description\":\"To train a viable AI model, you need data. Lots of it. But what do you do if there just isn't enough? Simple: you make some up. Or, to put it in fancier terms, you \\u201cgenerate synthetic data\\u201d.\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/innovatrics.com\/trustreport\/the-magic-of-synthetic-data\/\"]}]},{\"@type\":\"Person\",\"@id\":\"https:\/\/innovatrics.com\/trustreport\/#\/schema\/person\/aa8ac119593dd2e3e7e0e0fe172a40fc\",\"name\":\"Kristina Sebejova\",\"image\":{\"@type\":\"ImageObject\",\"@id\":\"https:\/\/innovatrics.com\/trustreport\/#personlogo\",\"inLanguage\":\"en-US\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/3f3afee03f3588bdfd390a79fbeea359?s=96&d=mm&r=g\",\"caption\":\"Kristina Sebejova\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","_links":{"self":[{"href":"https:\/\/innovatrics.com\/trustreport\/wp-json\/wp\/v2\/posts\/4151"}],"collection":[{"href":"https:\/\/innovatrics.com\/trustreport\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/innovatrics.com\/trustreport\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/innovatrics.com\/trustreport\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/innovatrics.com\/trustreport\/wp-json\/wp\/v2\/comments?post=4151"}],"version-history":[{"count":73,"href":"https:\/\/innovatrics.com\/trustreport\/wp-json\/wp\/v2\/posts\/4151\/revisions"}],"predecessor-version":[{"id":5550,"href":"https:\/\/innovatrics.com\/trustreport\/wp-json\/wp\/v2\/posts\/4151\/revisions\/5550"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/innovatrics.com\/trustreport\/wp-json\/wp\/v2\/media\/5415"}],"wp:attachment":[{"href":"https:\/\/innovatrics.com\/trustreport\/wp-json\/wp\/v2\/media?parent=4151"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/innovatrics.com\/trustreport\/wp-json\/wp\/v2\/categories?post=4151"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/innovatrics.com\/trustreport\/wp-json\/wp\/v2\/tags?post=4151"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}