SqueakPose Studio:一个端到端的平台,用于姿势估计和实时边缘AI部署
bioRxiv : the preprint server for biology
|February 9, 2026
概括
我们开发了一个用于姿势估计的集成系统,使得边缘设备上的实时动物行为分析成为可能. 这个平台简化了数据收集,模型培训和部署,而不需要强大的工作站.
科学领域:
- 行为神经科学 行为神经科学
- 计算生物学是一种计算生物学.
- 机器学习 机器学习
背景情况:
- 准确的姿势估计对于定量行为分析至关重要.
- 当前的深度学习工具通常需要复杂的离线工作流程和专门的硬件.
- 由于软件碎片化和硬件限制,实时部署姿势估计模型具有挑战性.
研究的目的:
- 呈现一个集成的软件硬件生态系统,用于位估计.
- 为了实现从数据集创建到边缘设备上的实时部署的无过渡.
- 克服现有的离线中心姿势估计工具的局限性.
主要方法:
- 开发了SqueakPose Studio用于数据集创建,标记,训练和离线推理.
- 利用现代物体检测架构进行高效的端到端训练和推理.
- 集成的SqueakView和MouseHouse可在嵌入式边缘计算硬件上实时部署.
主要成果:
- 该系统支持跨CPU,GPU和Apple Silicon的高效姿势估计.
- 启用实时模型部署,视频捕获和边缘设备上的传感器日志.
- 通过共享数据格式和确定时间,确保线下分析和实时部署之间的一致性.
结论:
- SqueakPose生态系统为线下和实时的姿势估计提供了一个统一的平台.
- 方便嵌入式边缘计算设备的行为分析,而不依赖于工作站级硬件.
- 推进深度学习的可访问性和应用,用于实验环境中的定量行为分析.
相关概念视频
02:57Real Time RT-PCR
65.3K
Real-time reverse transcription-polymerase chain reaction, or Real-time RT-PCR, is an analytical tool used to determine the expression level of target genes. The method involves converting mRNA to complementary DNA with the help of an enzyme known as reverse transcriptase, followed by the PCR amplification of the cDNA. These two processes can be performed simultaneously in a single tube or separately as a two-step reaction.
The real-time quantification of the number of amplified products is...
The real-time quantification of the number of amplified products is...
65.3K
01:06What are Estimates?
8.9K
It isn't easy to measure a parameter such as the mean height or the mean weight of a population. So, we draw samples from the population and calculate the mean height or mean weight of the individuals in the sample. This sample data acts as a representative measure of the population parameter. These sample statistics are known as estimates.
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such...
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such...
8.9K
01:20Estimation of k and VD of Aminoglycosides
250
Aminoglycosides are a class of antibiotics used to treat various bacterial infections. Clinicians must determine the elimination rate constant (k) and volume of distribution (VD) to optimize therapeutic efficacy and minimize toxicity. The k value represents the rate at which the drug is removed from the body, and the VD reflects the degree to which the drug distributes into body tissues. Accurately estimating these parameters allows healthcare professionals to tailor drug dosing to individual...
250
01:05Estimation of the Physical Quantities
7.9K
On many occasions, physicists, other scientists, and engineers need to make estimates of a particular quantity. These are sometimes referred to as guesstimates, order-of-magnitude approximations, back-of-the-envelope calculations, or Fermi calculations. The physicist Enrico Fermi was famous for his ability to estimate various kinds of data with surprising precision. Estimating does not mean guessing a number or a formula at random. Instead, estimation means using prior experience and sound...
7.9K
01:27Real Number System
1.2K
The real number system includes all numbers used for counting, measuring, and comparing quantities. Natural numbers are the basic counting numbers: 1, 2, 3, and so on. Integers expand this set by including zero and negative whole numbers: ..., –3, –2, –1, 0, 1, 2, .... Rational numbers are those that can be expressed as the ratio of two integers m/n, where n≠0. This includes fractions like 1/2, integers such as 46, and decimals that terminate, such as 0.17, or...
1.2K
01:26Estimating Population Standard Deviation
3.4K
When the population standard deviation is unknown and the sample size is large, the sample standard deviation s is commonly used as a point estimate of σ. However, it can sometimes under or overestimate the population standard deviation. To overcome this drawback, confidence intervals are determined to estimate population parameters and eliminate any calculation bias accurately. However, this only applies to random samples from normally distributed populations. Knowing the sample mean and...
3.4K