As for PE choice for dogtooth, I usually use 2 set ups. One with PE5 and another one with PE6.
PE5 goes for deeper spots, more than 90-100m, when you have to use heavier jig, but PE5 lets you use a bit lighter jigs without fatigue.
PE6 goes for depth less than 90 meters. You can still use lighter jigs but have more power in line.
I used to use PE8 in past, but I stopped because its big drift (i am not sure i said it right in English).
But after my last trip, I came to a thought that if your trip is dogtooth jigging dedicated trip and if you use PE5, you have to change line every 3 days, because three days of fast jigging spoils the line and it starts to break on fish. I had a lot of big hook ups and line breaks just in the middle. After inspecting the line I saw a lot of very little defects arised on first 100m lengh, as i thought, from a contact with the rings in a process of speed jigging. The line was new Varivas Max Power. So, from this point of view, PE8 may be more durable, though it is much harder for working jigs.
And I am very agree with Mark. Landing big dogtooth has a big part of luck and not only tackles.