Talk:Project Gotham Racing 2 - Revision history

JayFoxRox: Updated, but still broken

2017-09-24T09:12:31Z

Updated, but still broken

JayFoxRox: /* Hacky python script to extract PAK textures */

2017-09-23T19:09:49Z

‎Hacky python script to extract PAK textures

Show changes

JayFoxRox: /* Hacky python script to extract PAK textures */ new section

2017-09-23T16:38:50Z

‎Hacky python script to extract PAK textures: new section

Show changes

JayFoxRox: Added more chunk types and some basic info

2017-09-23T08:03:30Z

Added more chunk types and some basic info

Zaykho: /* Reverse engineering notes for file formats */

2017-09-22T18:08:56Z

‎Reverse engineering notes for file formats

Zaykho: /* Reverse engineering notes for file formats */

2017-09-22T18:08:18Z

‎Reverse engineering notes for file formats

Zaykho: /* Reverse engineering notes for file formats */

2017-09-22T18:06:05Z

‎Reverse engineering notes for file formats

Zaykho: /* Reverse engineering notes for file formats */

2017-09-22T18:02:05Z

‎Reverse engineering notes for file formats

Zaykho: /* Reverse engineering notes for file formats */ new section

2017-09-22T17:34:19Z

‎Reverse engineering notes for file formats: new section

New page

== Reverse engineering notes for file formats ==

--[[User:Zaykho|Zaykho]] ([[User talk:Zaykho|talk]]) 10:34, 22 September 2017 (PDT)

Project Gotham Racing 2 use a .PAK container for storing 3D elements, textures and 3D configurations files.

Multiple types of .PAK name can be seen in PGR2, their names are related to their functions and indicate what type of elements are stored:

'''.PAK for objects''' ( Cache\Objects & Cache\Cars )

----

.pak

'''.PAK for cars''' ( Cache\Cars )

----

.pak_cth

.pak_hrd

.pak_opn ( only for roadster : open mode)

.pak_sft ( only for roadster : closed mode for rain)

'''.PAK for maps''' ( Game\Areas )

----

.pak_common

.pak_day

.pak_night

.pak_overcast

.pak_stream

To extract those .PAK files, a tool called [http://aluigi.altervista.org/quickbms.htm quickbms] and a [http://aluigi.altervista.org/bms/project_gotham_2_pak.bms PGR2 bms script] ( both made by Luigi Auriemma ) can be used to get most of the contents stored in the archive.

When extracted, the actual content stored in the archive is sliced in sections, creating a folder for each of them.

Here an example for objects:

'''.PAK for objects'''

----

WMSH \ 00000000.dat

MAT \ 00000001.dat

GPUD \ 00000002.dat

TEXT \ 00000003.nfc

VB \ 00000004.dat

END ( nothing, no folder, no files )

@@ Line 234: / Line 234: @@
      for b in compressed:
        data += decompress.decompress(compressed)
    except:
      print("Decompression failed after " + str(len(data)) + ' / ' + str(SIZE) + ' bytes')
@@ Line 387: / Line 388: @@
      data = log(f, NAME, OFFSET, SIZE)
-   if chunkType == b'WMSH':
+   if chunkType == b'GPUD':
      gpud = data
@@ Line 500: / Line 496: @@
    elif chunkType == b'MESH' or chunkType == b'WMSH':
      # Originally written for MESH, also might work for WMSH
-     offset = 52
      indices = []
-     for i in range(0, 20000): #FIXME: Number of indices
+     for i in range(0, count): #FIXME: Number of indices
        j = struct.unpack('<H', data[offset:offset+2])[0]
        indices += [j]
        offset += 2
      mesh = {}
      mesh['indices'] = indices
@@ Line 558: / Line 610: @@
        print("VB: " + str(vb['offset']))
        offset = vb['offset']
-       for i in range(0, 100):
+       for i in range(0, 138):
          print(i) # Helper so we can figure out when the parser hangs
@@ Line 583: / Line 635: @@
            v = struct.unpack('<h', gpud[offset:offset+2])[0] / 512
            offset += 2
          if True: # /tmp/Red Cone.pak
            #FIXME: Broken still!
            x = struct.unpack('<f', gpud[offset:offset+4])[0]
@@ Line 594: / Line 670: @@
            offset += 4
-           offset += 6
+           u = struct.unpack('<h', gpud[offset:offset+2])[0]
-          print("xyz: %f %f %f; uv: %f %f" % (x,y,z, u,v))
+        print("xyz: %f %f %f; uv: %f %f" % (x,y,z, u,v))
-          e.write('v %f %f %f\n' % (x,y,z))
+        e.write('v %f %f %f\n' % (x,y,z))
-          e.write('vt %f %f\n' % (u,v))
+        e.write('vt %f %f\n' % (u,v))
      for mesh in meshs:
@@ Line 627: / Line 713: @@
          image = Image.frombytes('RGBA', (texture['width'], texture['height']), data, 'bcn', 3)
        elif texture['format'] == 0x021C:
          image = Image.frombytes('RGBA', (texture['width'], texture['height']), data, 'bcn', 1)
        else:

@@ Line 44: / Line 44: @@
 .pak_overcast
-.pak_stream
+.pak_stream (This uses a non-standard PAK format)
@@ Line 72: / Line 72: @@
 END ( nothing, no folder, no files )
-'''WMSH''' or sometime '''MESH'''
+The chunk can contain compressed or uncompressed data. Compression is probably indicated by the upper bits of the size (0xC0000000) being set.
-----
+Data can be inline, directly following the header. However, in INDX chunks, the data is pointed to by an extra u32 field after each header.
 The ''00000000.dat'' file contain the '''faces indices''', and ''supposedly'', the '''strip''' and the how the vertices are read '''( float, word ? )'''.
-'''MAT'''
+==== MAT ====
-----
+Material properties
 The ''00000001.dat'' file contain the '''material''' properties : diffuse, specular, ambient etc... of each material applied to the 3D file.
-'''GPUD'''
+==== RCAM ====
-----
 The ''00000002.dat'' file contain all the '''textures''', each of them followed by a small part of data ''( texture configuration ? mipmaps ? )''. Finally, after all the textures, the '''vertices and UV position''' are stored in one chunk of data.
-'''TEXT'''
+Texture information
 The ''00000003.dat'' file contain all the '''text and name''' related to the texture, it also indicate where each textures are located inside '''GPUD'''.
-'''VB'''
+Vertex buffer information
 The ''00000004.dat'' file contain the '''start address offset''' of the vertices and UV section in the '''GPUD'''. If the 3D mesh have multiples groups/sections, the VB file will store each address.

← Older revision		Revision as of 18:08, 22 September 2017
Line 108:		Line 108:
	----		----

−	The ''00000004.dat'' file contain the '''start address offset''' of the vertices and UV section in '''GPUD'''. If the 3D mesh have multiples groups/sections, the VB file will store each address.	+	The ''00000004.dat'' file contain the '''start address offset''' of the vertices and UV section in the '''GPUD'''. If the 3D mesh have multiples groups/sections, the VB file will store each address.

@@ Line 56: / Line 56: @@
-'''.PAK for objects : red_cone.pak '''
+'''.PAK for object : red_cone.pak '''
 ----
@@ Line 94: / Line 94: @@
 ----
-The ''00000002.dat'' file contain all the '''textures''', each of them followed by a small part of data ''( texture configuration ? mimaps ? )''. Finally, after all the textures, the '''vertices and UV position''' are stored in one chunk of data.
+The ''00000002.dat'' file contain all the '''textures''', each of them followed by a small part of data ''( texture configuration ? mipmaps ? )''. Finally, after all the textures, the '''vertices and UV position''' are stored in one chunk of data.

← Older revision		Revision as of 18:06, 22 September 2017
Line 102:		Line 102:

	The ''00000003.dat'' file contain all the '''text and name''' related to the texture, it also indicate where each textures are located inside '''GPUD'''.		The ''00000003.dat'' file contain all the '''text and name''' related to the texture, it also indicate where each textures are located inside '''GPUD'''.
		+
		+
		+	'''VB'''
		+
		+	----
		+
		+	The ''00000004.dat'' file contain the '''start address offset''' of the vertices and UV section in '''GPUD'''. If the 3D mesh have multiples groups/sections, the VB file will store each address.

@@ Line 5: / Line 5: @@
 Project Gotham Racing 2 use a .PAK container for storing 3D elements, textures and 3D configurations files.
 Multiple types of .PAK name can be seen in PGR2, their names are related to their functions and indicate what type of elements are stored:
@@ Line 51: / Line 50: @@
 To extract those .PAK files, a tool called [http://aluigi.altervista.org/quickbms.htm quickbms] and a [http://aluigi.altervista.org/bms/project_gotham_2_pak.bms PGR2 bms script] ( both made by Luigi Auriemma ) can be used to get most of the contents stored in the archive.
-When extracted, the actual content stored in the archive is sliced in sections, creating a folder for each of them.
+When extracted, the content stored in the archive is sliced in sections, creating a folder for each of them and joining a file with the actual contents in it, mostly with a '''.dat''' suffix.
 Here an example for objects:
 '''.PAK for objects'''
 ----
@@ Line 71: / Line 71: @@
 END ( nothing, no folder, no files )