Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(ml): improved ARM-NN support #11233

Merged
merged 1 commit into from
Jul 20, 2024
Merged

Conversation

fyfrey
Copy link
Contributor

@fyfrey fyfrey commented Jul 19, 2024

  • updates ARM-NN from version 23.11 to 24.05
  • allow loading both fp16 and fp32 models with optional fp16 turbo
  • new ML env config ann_fp16_turbo (default False)
  • new ML env config ann_tuning_level (default 2)
  • add documentation

Copy link
Contributor

@mertalev mertalev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks for fixing this!

@mertalev
Copy link
Contributor

Could you add the new env to the env docs? A mention of it in the hardware acceleration doc would be nice too for visibility.

@fyfrey fyfrey force-pushed the fix/armnn-more-model-support branch from 492a146 to c86d77f Compare July 20, 2024 06:35
@fyfrey fyfrey changed the title fix(ml): support more ARMNN models feat(ml): improved ARM-NN support Jul 20, 2024
@github-actions github-actions bot added the documentation Improvements or additions to documentation label Jul 20, 2024
@mertalev mertalev merged commit 54488b1 into main Jul 20, 2024
25 checks passed
@mertalev mertalev deleted the fix/armnn-more-model-support branch July 20, 2024 19:59
claabs pushed a commit to claabs/immich-machine-learning-openvino-kernel-fix that referenced this pull request Aug 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation 🧠machine-learning
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants