Introducing Orca, Microsoft's groundbreaking open source AI model!

Microsoft Research introduces Orca, a new AI model that learns by imitating large language models like GPT-4

Photo Credit - Freepik

With 13 billion parameters, Orca can imitate and learn from GPT-4, improving skills and capabilities.

[{"selector":"#anim-3b4a74c3-4dfd-41cb-85ca-752c8becfb3c","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-1c6c9c1c-18b0-4097-9af3-fcc705d86b0d","keyframes":{"transform":["translate3d(-113.9394%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-2e367060-a98d-4e9f-b86d-10940d2cc66e [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(-2.842170943040401e-14%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] Photo Credit - Freepik

Orca overcomes limitations of smaller models by imitating the reasoning processes of larger foundation models.

[{"selector":"#anim-401440f5-18ba-4a1e-9ce9-52f282f2a18d","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-ae4abfb9-ae3b-468c-a4e5-80010a4137fb","keyframes":{"transform":["translate3d(-115.18988%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-09d185e8-7e11-4ddd-859f-8a83801e21c2 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, -0.000004087889653447974%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] Photo Credit - Freepik

It can be optimized for specific tasks & trained using large language models, requiring fewer computing resources to run.

[{"selector":"#anim-35a2446c-40de-4f9f-9258-2d4b660eb65d","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-8afbf206-8d30-472d-bcc1-3543cbb79649","keyframes":{"transform":["translate3d(-115.18988%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-20d15a48-3767-4055-ac74-0f3d99422bc3 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] Photo Credit - Freepik

Orca demonstrates competitive performance on reasoning benchmarks and academic exams like SAT, LSAT, GRE, and GMAT.

[{"selector":"#anim-0043884c-b029-4bb2-a24c-6745d829c421","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-1517b10a-1081-4b97-857e-6281f4783fc9","keyframes":{"transform":["translate3d(-115.2381%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-0f3b2874-b1b2-4633-8b0e-ffc68fa284a4 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(0%, -0.0000023971264688782412%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] Photo Credit - Freepik

Orca surpasses previous models like Vicuna by 100% on complex zero-shot reasoning benchmarks.

[{"selector":"#anim-6b948259-41ad-42bb-a55f-9ea1b95a57ee","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-55ec01f0-7a68-4eea-b1b8-4f8dfbb012f5","keyframes":{"transform":["translate3d(-115.2381%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-08bf8186-48e7-425c-b12c-d89ede8fdcb7 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(-1.7763568394002505e-14%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] Photo Credit - Freepik

Orca is 42% faster than conventional AI models on AGIEval benchmarks.

[{"selector":"#anim-70b7276e-2867-4a48-b64e-c8fe2f598fde","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-790a4081-472d-4100-b3e4-687bb41cbf75","keyframes":{"transform":["translate3d(-115.2381%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-bf73e367-d87d-4989-b7ea-c70968a9b184 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(-1.0658141036401503e-14%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] Photo Credit - Freepik

Orca learns step-by-step explanations from humans and advanced language models, showing potential for improved skills in the future.

[{"selector":"#anim-8ae18402-7547-43bf-b674-2f45f74f0e1f","keyframes":{"opacity":[0,1]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-d370dceb-42cd-46ca-8d0c-f3300ce5a0f1","keyframes":{"transform":["translate3d(-115.2381%, 0px, 0)","translate3d(0px, 0px, 0)"]},"delay":0,"duration":600,"easing":"cubic-bezier(0.2, 0.6, 0.0, 1)","fill":"both"}] [{"selector":"#anim-3f145972-e1cd-4eca-8c1b-638e5d3bd474 [data-leaf-element=\"true\"]","keyframes":{"transform":["translate(-2.842170943040401e-14%, 0%) scale(1.5)","translate(0%, 0%) scale(1)"]},"delay":0,"duration":2000,"easing":"cubic-bezier(.3,0,.55,1)","fill":"forwards"}] Photo Credit - Freepik

Get Latest Business News Updates on IEM

indianentrepreneursmagazine.in