phbs
The Value of AI in OM: Evidence from Field Experiments
2023-10-23 09:58:24
I will discuss two papers. In the first paper “AI and Procurement,” we study how buyers’ use of artificial intelligence (AI) affects suppliers’ price quoting strategies. Specifically, we study the impact of automation—that is, the buyer uses a chatbot to automatically inquire about prices instead of asking in person—and the impact of smartness—that is, the buyer signals the use of a smart AI algorithm in selecting the supplier. We collaborate with a trading company to run a field experiment on an online platform in which we compare suppliers’ wholesale price quotes across female, male, and chatbot buyer types under AI and no recommendation conditions. We find that, when not equipped with a smart control, there is price discrimination against chatbot buyers who receive a higher wholesale price quote than human buyers. In fact, without smartness, automation alone receives the highest quoted wholesale price. However, signaling the use of a smart recommendation system can effectively reduce suppliers’ price quote for chatbot buyers. We also show that AI delivers the most value when buyers adopt automation and smartness simultaneously in procurement.

In the second paper “Physician Adoption of AI Assistant,” we study AI assistants---software agents that can perform tasks or services for individuals---which are among the most promising AI applications. However, little is known about the adoption of AI assistants by service providers (i.e., physicians) in a real-world healthcare setting. In this paper, we investigate the impact of AI smartness (i.e., whether the AI assistant is empowered by machine learning intelligence) and the impact of AI transparency (i.e., whether physicians are informed of the AI assistant). We collaborate with a leading healthcare platform to run a field experiment in which we compare physicians’ adoption behavior, i.e., adoption rate and adoption timing, of smart and automated AI assistants under transparent and non-transparent conditions. We find that smartness can increase the adoption rate and shorten the adoption timing, while transparency can only shorten the adoption timing. Moreover, the impact of AI transparency on the adoption rate is contingent on the smartness level of the AI assistant: the transparency increases the adoption rate only when the AI assistant is not equipped with smart algorithms and fails to do so when the AI assistant is smart. Our study can guide platforms in designing their AI strategies. Platforms should improve the smartness of AI assistant. If such an improvement is too costly, the platform should transparentize the AI assistant, especially when it is not smart.