A Geometric View on Private Gradient-Based Optimization

Share this & earn $10
Google TechTalks
Published at : 30 Sep 2021
252 views
7
0

A Google TechTalk, presented by Steven Wu, 2021/04/16
ABSTRACT: Differential Privacy for ML Series. Deep learning models are increasingly popular in many machine learning applications where the training data may contain sensitive information. To provide formal and rigorous privacy guarantees, many learning systems now incorporate differential privacy in their model training. I will talk about our recent studies on the gradient distributions in private training trajectories, which often exhibit low-dimensional and symmetric structures. I will present how our results leverage these geometric structures to derive more accurate training methods and characterize their convergence behaviors.

About the speaker: Steven Wu is an Assistant Professor in the School of Computer Science at Carnegie Mellon University. His research focuses on (1) how to make machine learning better aligned with societal values, especially privacy and fairness, and (2) how to make machine learning more reliable and robust when algorithms interact with social and economic dynamics. In 2017, he received his Ph.D. in computer science at the University of Pennsylvania, where his doctoral dissertation received Penn’s Morris and Dorothy Rubinoff Award for best thesis. His research is supported by an Amazon Research Award, a Facebook Research Award, a Mozilla research grant, a Google Faculty Research Award, a J.P. Morgan Research Faculty Award, and the National Science Foundation.

GeometricPrivateGradient-Based

#Fanny video #hindi #commend

#Fanny video #hindi #commend

Whitney Houston - How Will I Know (Official Video)

Whitney Houston - How Will I Know (Official Video)

Whaldez  - Back to the Sturdiness [ Progressive House, Techno Mix ] 2018 September

Whaldez - Back to the Sturdiness [ Progressive House, Techno Mix ] 2018 September

The CS:GO experience 2 electric boogaloo

The CS:GO experience 2 electric boogaloo

Suppertime - Jim Reeves

Suppertime - Jim Reeves

The Straightforward Event Agency - Purple Patch Group London

The Straightforward Event Agency - Purple Patch Group London

ZOMBIES BUT WE START ON ROUND 100

ZOMBIES BUT WE START ON ROUND 100

MY FRIENDS CAME TO VISIT HARGEISA SOMALILAND 2021 - GIRLS TRIP VLOG

MY FRIENDS CAME TO VISIT HARGEISA SOMALILAND 2021 - GIRLS TRIP VLOG

Shadow Chancellor Points Blame At The Govt For Fuel Shortages & Discusses Labour's Visions | GMB

Shadow Chancellor Points Blame At The Govt For Fuel Shortages & Discusses Labour's Visions | GMB

NCT 127 엔시티 127 'Regular (English Ver.)' MV

NCT 127 엔시티 127 'Regular (English Ver.)' MV

Best Advertisement ever-Winner of Best Ad 2014

Best Advertisement ever-Winner of Best Ad 2014

Vast Majority - Move It 1976

Vast Majority - Move It 1976

President DONALD TRUMP Plays NBA 2K22

President DONALD TRUMP Plays NBA 2K22

Shiloh and bros, among us You choose all endings. (Read description)

Shiloh and bros, among us You choose all endings. (Read description)

Allen Stone - Consider Me (Official Music Video)

Allen Stone - Consider Me (Official Music Video)

Kylie Minogue and Jason Donovan - Especially For You - Official Video

Kylie Minogue and Jason Donovan - Especially For You - Official Video

Featuring : Girly Berry | Official MV

Featuring : Girly Berry | Official MV

Major Lazer & DJ Snake - Lean On (feat. MØ) (Official Music Video)

Major Lazer & DJ Snake - Lean On (feat. MØ) (Official Music Video)

Nicolas Jaar - Variations

Nicolas Jaar - Variations

When Jessie Came Across the Sea - April 2016

When Jessie Came Across the Sea - April 2016

What Are You Passionate About Interview Question: How to Answer

What Are You Passionate About Interview Question: How to Answer

security at a glance

security at a glance

The Theory of Information

The Theory of Information

Comparison: Most Useful Minecraft Items

Comparison: Most Useful Minecraft Items

Charlie Puth - We Don't Talk Anymore (Lyrics) feat. Selena Gomez

Charlie Puth - We Don't Talk Anymore (Lyrics) feat. Selena Gomez

DYSTINCT - Ya La Laa (prod. SRNO) / (ديستانكت - يا لا لا (بروود . سرنو

DYSTINCT - Ya La Laa (prod. SRNO) / (ديستانكت - يا لا لا (بروود . سرنو

Dino-Sized Brisket in TEXAS!! Best American Food BBQ!!

Dino-Sized Brisket in TEXAS!! Best American Food BBQ!!

The Twins Who’ve Spent £140K To Make Themselves Even More Identical | This Morning

The Twins Who’ve Spent £140K To Make Themselves Even More Identical | This Morning

Maitri Upanishad - A Selection for Meditation and Contemplation - Advaita - Vedanta

Maitri Upanishad - A Selection for Meditation and Contemplation - Advaita - Vedanta

They invent o The invent of galactose

They invent o The invent of galactose

Difference between consequently and subsequently|  uses of consequently and subsequently in sentence

Difference between consequently and subsequently| uses of consequently and subsequently in sentence

Drake - Take Care ft. Rihanna

Drake - Take Care ft. Rihanna

Laborious

Laborious

Neymar kicks Herrera after getting humiliated

Neymar kicks Herrera after getting humiliated

Customarily THE MOST EFFECTIV TREATMENT

Customarily THE MOST EFFECTIV TREATMENT

Ed Sheeran - Visiting Hours [Official Performance Video]

Ed Sheeran - Visiting Hours [Official Performance Video]

Performance - Theatrical Trailer

Performance - Theatrical Trailer

ORDINARY (Little Miss Perfect Sequel) lyric video

ORDINARY (Little Miss Perfect Sequel) lyric video

Christina Perri - A Thousand Years [Official Music Video]

Christina Perri - A Thousand Years [Official Music Video]

OMG!!🤩They Offered Shadow Dragon Owl Kangaroo And Adds😍Quick Yes Or No?🤤🥳🥰

OMG!!🤩They Offered Shadow Dragon Owl Kangaroo And Adds😍Quick Yes Or No?🤤🥳🥰

LOONY - either side (Lyrics)

LOONY - either side (Lyrics)

If It's Tuesday, This Must Be Belgium

If It's Tuesday, This Must Be Belgium

كن عظيماً Smart way :

كن عظيماً Smart way :

Extended Cut - Ellen Gives a Deserving Family the Single Biggest Gift Ever!

Extended Cut - Ellen Gives a Deserving Family the Single Biggest Gift Ever!

Hopsin - Your House

Hopsin - Your House

Jointly - Friday Night Funkin': Mid-Fight Extras (Album)

Jointly - Friday Night Funkin': Mid-Fight Extras (Album)

7 Rules An Elegant Lady Should Follow

7 Rules An Elegant Lady Should Follow

*NSYNC - It's Gonna Be Me (It's Gonna Be May - Official Video)

*NSYNC - It's Gonna Be Me (It's Gonna Be May - Official Video)

Digital Exclusive: The Problem With My Staff | The Problem With Jon Stewart | Apple TV+

Digital Exclusive: The Problem With My Staff | The Problem With Jon Stewart | Apple TV+