Skip to content

[FEAT] Add NPU Engine #28

Open
Open
@szeyu

Description

@szeyu

Is your feature request related to a problem? Please describe.

Intel has its own npu runtime library
Reference : Phi-3 Cookbook - Intel NPU acceleration library

Describe the solution you'd like

Hence, NPU engine can be added to this repo

Additional context

Update in:

  • modelui.py
  • engine.py
  • setup.py
  • README.md

Add:

  • npu_egnine.py
  • requirements-npu.txt
  • npu_models.md

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions