There is ipex-llm from Intel which you can use with your intel IGPU/GPU/CPU for llms.