最新技术:文化基准测试的时间顺序
1Department of Geography, Durham University, Lower Mountjoy, South Road, Durham, DH1 3LE UK.
概括
机器学习基准测试通过规范化进展并强调当前的最先进技术,创造了一个以当前为重点的研究文化. 这种时间结构影响着研究方向和期望.
科学领域:
- 计算机科学 计算机科学
- 科学哲学的哲学科学哲学
背景情况:
- 机器学习研究在很大程度上依赖于基准和评估.
- 现有的批评往往侧重于统计学有效性和基准的代表性.
研究的目的:
- 分析机器学习的基准文化产生的时间价值和期望.
- 调查基准测试如何影响研究的节奏和方向.
主要方法:
- 评论和理论分析.
- 制定两个假设:规范化研究和推断.
- 在时间结构中检查认识价值.
主要成果:
- 基准测试通过提供纪律和激励功能,尽量减少冲突,使研究正常化.
- 在基准测试中的增量进步是面向当前最先进的技术 (SOTA),而不是未来.
- 这导致了机器学习评估中的现实主义时间性.
结论:
- 机器学习的基准评价文化培养了当下主义的导向.
- 这个时间结构塑造了研究实践和期望.
- 在AI评估中,需要进一步研究时间值.
相关概念视频
Framing Effects
7.3K
Information is everywhere and its presentation—such as how and when items are presented—can impact our perceptions and decisions surrounding the info. This broad concept umbrellas framing effects—influences that occur due to the way information is framed in its appearance, whether it’s purely the order or the specific wording of a message. Let’s take a look at numerous ways in which two versions of something can objectively say the same thing, yet we respond in...
7.3K
Social Proof
27.2K
Social proof is a form of persuasion based on comparison and conformity. People compare their behavior and actions to what others are doing and will change to conform to do what their peers do.
27.2K
Cultural Influences on Personality
81
Individualist and collectivist cultures emphasize different core values, shaping personality in distinct ways. In individualist cultures, such as those in the United States, England, and Australia, people prioritize independence, competition, and personal achievement. These societies tend to promote self-focused traits, with individuals often reporting higher levels of self-esteem. In contrast, collectivist cultures, commonly found in regions like Asia, Africa, and South America, emphasize...
81
Stereotype Content Model
13.9K
The Stereotype Content Model (SCM) was first proposed by Susan Fiske and her colleagues (Fiske, Cuddy, Glick & Xu, 2002; see also Fiske, 2012 and Fiske, 2017). The SCM specifies that when someone encounters a new group, they will stereotype them based on two metrics: warmth—or that group’s perceived intent, and how likely they are to provide help or inflict harm—and competence—or their ability to carry out that objective. Depending on the warmth-competence...
13.9K
Self-Presentation: Self-Monitoring and Self-Handicapping
38.6K
People can go to great lengths to protect their self-image and present themselves in ways that they want others to see them. Sociologist Erving Goffman presented the idea that a person is like an actor on a stage. Calling his theory dramaturgy, Goffman believed that we use “impression management” to present ourselves to others as we hope to be perceived. Each situation is a new scene, and individuals perform different roles depending on who is present (Goffman, 1959). Think about...
38.6K
Robbers Cave
14.2K
During the 1950s, the landmark Robbers Cave experiment demonstrated that when groups must compete with one another, intergroup conflict, hostility, and even violence may result. At the Oklahoman summer camp, two troops of boys—termed the Rattlers and the Eagles—took part in a week-long tournament. During this time, their negativity culminated in derogatory name-calling, fistfights, and even vandalism and destruction of property. However, this work also revealed that such tension...
14.2K


