The Avatar production generates terabytes of data in various formats, including massive digital files used in creating Avatar’s all-digital, virtual filming environment, small metadata and instructional files, still frames for review, and large media files from Avid systems.

In fact Avatar intense production pipeline created terabytes of data on a weekly and even daily basis, demanding a storage solution with the concurrent performance, scalability and ease of management necessary. Isilon clustered storage with unique “pay as you grow” architecture ensured Avatar‘s scalability and performance issues both. Apart from that, our very own kiwi Weta Digital, which worked out photo-realistic CGI rendering work for Avatar, used similar kind of scalability solution. According to this article

Weta used NetApp kit to store the incoming data, then used a huge number of workstations and bladed servers – with 30,000 cores in total – to work on it. The NetApp filers were fitted with up to five 160GB DRAM cache accelerator cards in their controllers, the PAM (Performance Acceleration Modules) caches, to speed file access by the Weta creative people and the servers.

Finally Cameron’s Lightstorm Entertainment used FASP v2.0 transport technology from Aspera, a high-performance and secure file transfer solution which enabled the bulk transfer of electronic files between Los Angeles and New Zealand on a daily basis.