Oldest Papers
How Far I'll Go: Offline Goal-Conditioned Reinforcement Learning via $f$-Advantage Regression
Yecheng Jason Ma, Jason Yan, Dinesh Jayaraman, Osbert Bastani
arXiv·2022
Offline goal-conditioned reinforcement learning (GCRL) promises general-purpose skill learning in the form of reaching diverse goals from purely offline datasets. We propose $\textbf{Go}$al-conditioned $f$-$\textbf{A}$dvantage $\textbf{R}$egression (GoFAR), a novel regression-based offline GCRL algorithm derived from a state-occupancy matching perspective; the key intuition is that the goal-reaching task can be formulated as a state-occupancy matching problem between a dynamics-abiding imitator agent and an expert agent that directly teleports to the goal. In contrast to prior approaches, GoFAR does not require any hindsight relabeling and enjoys uninterleaved optimization for its value and policy networks. These distinct features confer GoFAR with much better offline performance and stability as well as statistical performance guarantee that is unattainable for prior methods. Furthermore, we demonstrate that GoFAR's training objectives can be re-purposed to learn an agent-independent goal-conditioned planner from purely offline source-domain data, which enables zero-shot transfer to new target domains. Through extensive experiments, we validate GoFAR's effectiveness in various problem settings and tasks, significantly outperforming prior state-of-art. Notably, on a real robotic dexterous manipulation task, while no other method makes meaningful progress, GoFAR acquires complex manipulation behavior that successfully accomplishes diverse goals.
No ratings yet
View paper →Chesa Boudin Recall: How San Francisco Became a Failed City - The Atlantic
Nellie Bowles
The Atlantic·2022
And how it could recover
No ratings yet
View paper →A reimbursement framework for artificial intelligence in healthcare
Michael D. Abràmoff, Cybil Roehrenbeck, Sylvia Trujillo, Juli Goldstein, Anitra S. Graves, Michael X. Repka, Ezequiel “Zeke” Silva III
npj Digital Medicine·2022·80 citations
No abstract available
No ratings yet
View paper →Re-Imagining Wellness in the Age of Neoliberalism
Sarah Badr
New Sociology: Journal of Critical Praxis·2022·6 citations
<jats:p>In this article, I explore the neoliberalization of wellness practices and the negative impact that this has had on the production and consumption of food products otherwise considered ‘healthy’ and or ‘ecofriendly’. Specifically, I argue that capitalist notions of productivity and wellness have become intertwined, resulting in the large-scale destruction of both our environment and of the politically and economically marginalized. First, I examine the capitalist co-option of the concept of self-care and its origins in the 1960s civil rights movement as a response to a discriminatory medical establishment. Afterward, I explore the corporate-led evolution of wellness culture, illustrating its consequences for the environment, and the security and health of marginalized populations around the world. Finally, I argue that holistic and community-centered concepts of productivity and wellness are necessary for combatting inequality and climate crisis.
</jats:p>
No ratings yet
View paper →