recommendation algorithms that power amazon, netflix can improve satellite imagery, too
The statistics and sample data from the training dataset. Credit: International Journal of Applied Earth Observation and Geoinformation (2022). DOI: 10.1016/j.jag.2022.102770

Algorithms that help consumers decide what to stream or buy online can do more than predict customers’ habits: They can help satellites see the Earth better, according to a Rutgers study.

Optical satellites lose sight of the Earth’s surface when it is covered by clouds, and researchers have long relied on inaccurate tools to fill the blind spots, particularly along coastlines. By adapting a recommendation algorithm first built for Netflix, Ruo-Qian (Roger) Wang, an assistant professor of civil and environmental engineering at the Rutgers School of Engineering, created a system that is more accurate and faster at predicting cloud-covered landscapes in coastal areas than conventional data-filling tools.

The findings are published in the International Journal of Applied Earth Observation and Geoinformation.

“E-service platforms like Alibaba and Amazon use recommender systems, which leverage large datasets to provide customized product recommendations to aid customers’ decision making,” Wang said. “Interestingly, the way recommender systems process data is not unlike the process for predicting coastal landscapes obscured by clouds.”

In the open ocean, cloud-filling algorithms used in remote sensing measure continuous data—such as water temperature, color and algae content—to make predictions of what is hidden. But these solutions break down along the coast, where “errors are magnified due to increased cloud cover, vegetation and other variables,” said Wang, adding recommender systems “could do a better job in this objective.”

To test his hypothesis, Wang built a cloud-filling model atop the work of Simon Funk, a software developer who won a Netflix recommending tool competition. The algorithm, called Funk-SVD, plots consumer reviews on a matrix. This data is then used to predict the viewing habits of users who did not record a review.

It’s a similar process for cloud filling: Each coordinate on a map is represented by a pixel on a photograph and that pixel can either be water or land, with clouds representing unrecorded data. Wang’s adaptation of Funk-SVD makes guesses on what is beneath the clouds based on other data points.

Using an image database of 258 frames derived from Landsat missions in the Delaware Bay, Wang trained Funk-SVD to complete the cloud-filling scheme. His solution was more accurate than the most widely used cloud-filling tool, DINEOF (Data-Interpolating Empirical Orthogonal Functions), and achieved similar accuracy to another popular tool, Datawig, which is powered by machine learning. While Datawig uses vast computer power and can take days to process, Wang’s solution took 30 seconds.

Wang said his solution has numerous applications for long-term Earth observation. The method could be used to measure crop production, for instance, or to map the pace of urbanization across large areas. It can do so faster and cheaper than conventional methods, too.

“Any general land-use change could be monitored using this tool,” said Wang. More information: Ruo-Qian Wang, A recommender system-inspired cloud data filling scheme for satellite-based coastal land use classification, International Journal of Applied Earth Observation and Geoinformation (2022). DOI: 10.1016/j.jag.2022.102770 Provided by Rutgers University Citation: Recommendation algorithms that power Amazon, Netflix can improve satellite imagery, too (2022, May 11) retrieved 11 May 2022 from https://techxplore.com/news/2022-05-algorithms-power-amazon-netflix-satellite.html This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.

TECH NEWS RELATED

D2C skincare brand Ras Luxury Oils raises $2 million funding from Sixth Sense

ETtechMumbai: Ras Luxury Oils, a direct to consumer (D2C) luxury skincare and personal care brand, has raised $2 million in a funding round from Sixth Sense Ventures, the company said.It said it would use the funds to develop and launch new product categories, expand deeper into marketplaces, and establish an ...

View more: D2C skincare brand Ras Luxury Oils raises $2 million funding from Sixth Sense

FCA chair warns against ‘speculative crypto tokens’ with ‘no underlying value’

The UK’s Financial Conduct Authority (FCA) chair has questioned the legitimacy of speculative crypto tokens and highlighted the challenges facing the watchdog in regulating the cryptocurrency sector. In a speech given on Friday, FCA chair Charles Randell expressed scepticism about “speculative crypto tokens”. Cryptoassets have been a hot topic ...

View more: FCA chair warns against ‘speculative crypto tokens’ with ‘no underlying value’

Can Subsea Cables Detect Earthquake? UK Researchers Claim It’s Possible Through Making Seafloor Sensors!

Researchers might use seafloor internet connections to detect earthquakes and tsunamis and monitor how climate change affects ocean currents. The UK’s National Physical Laboratory (NPL) and its collaborators claim that these telecom cables might be utilized as a massive array of deep-sea scientific instruments. Experts tested the technology on an ...

View more: Can Subsea Cables Detect Earthquake? UK Researchers Claim It’s Possible Through Making Seafloor Sensors!

BRIM Biotechnology, Inc. and Ora, Inc. Announce New Partnership to Accelerate the Development of Regenerative Peptide Therapy, BRM421 for Dry Eye Syndrome

BRIM Biotechnology, Inc. (“BRIM”), a clinical-stage company developing novel regenerative therapies in ophthalmology, today announces it has entered into a new strategic partnership with Ora®, Inc. (“ORA”), the world’s leading ophthalmic research organization, for the late-stage clinical development of lead drug candidate, BRM421, for dry eye syndrome (DES). BRIM intends ...

View more: BRIM Biotechnology, Inc. and Ora, Inc. Announce New Partnership to Accelerate the Development of Regenerative Peptide Therapy, BRM421 for Dry Eye Syndrome

Thynk Health Welcomes Jim Farmer as Senior Vice President of Sales

Thynk Health, the Complete Incidental Findings and Cancer Screening Management Solution welcomes  Jim Farmer as Senior Vice President of Sales. With over 30 years of experience in executive management and business thought leadership, Jim excels at creating scalable, sustainable growth for early and growth-stage technology-based companies. Utilizing his strengths as ...

View more: Thynk Health Welcomes Jim Farmer as Senior Vice President of Sales

Broadcom reportedly looking at acquiring cloud company VMWare

Chipmaking giant is hoping to solidify its software base to give it more flexibility in targeting the data centre market

View more: Broadcom reportedly looking at acquiring cloud company VMWare

ICO hands out £7.5m fine for Clearview AI

Australian facial recognition firm also ordered to stop obtaining and using UK resident's personal data

View more: ICO hands out £7.5m fine for Clearview AI

China's FAST initially detects new phenomenon of 'Black Widow' pulsars

The Five-hundred-meter Aperture Spherical Radio Telescope (FAST) installed in Pingtang County, Guizhou Province, southwest China. /CFP Chinese researchers used the Five-hundred-meter Aperture Spherical Radio Telescope (FAST), the world’s largest single-dish and most sensitive radio telescope developed by China, to detect the extreme turbulence of plasma in the dense binary ...

View more: China's FAST initially detects new phenomenon of 'Black Widow' pulsars

Apple looks to move more production out of China: report

Windows 11's nifty new search feature has one major downside

Japan Looks To Boost Space Program — But Needs US Help To Do So

The First Xiaomi Mi 13 Rumors Began Appearing On The Net

How to build fast without burning out: 6 tips from Target's SVP of Product Engineering

Industry Facing “Once-in-a-Century” Pivot – Snow Lake Lithium CEO

Lazada hosts 2022’s first physical IT fair at Plaza Singapura

UK fintech Atom Bank eyes New York listing via SPAC merger – report

U.S.-led IPEF outweighs China-involving RCEP in population, GDP

CarTrade Tech ties up with Cholamandalam for financing used cars

WhatsApp to end support for iOS 10, 11

Former Twitter India head Manish Maheshwari's startup Invact Metaversity is considering winding down operations

OTHER TECH NEWS

Top Car News Car News