PS3 Fault finding YLOD with the SYSCON - First steps and Error reporting

Awesome work Felix. Your research and comprehensive explanations are incredible. It's like engineering deciphered. Finally somebody is able to break it all down into understandable language.



Curious to what schematics you used ? I have built my own BGA as well, but now realized it still needs more work.



In my case, I got the reballing part down after figuring out a perfect amount of flux (extremely thin layer). But with a DIY bga machine and no proper fixture, if the board is allowed to flex too much, the balls could merge or not solder properly. That has been a massive challenge for me personally. Basically the last and most important step of the process...

i followed this guide here, just changed the neutral line and hot line into 2 hot lines. 120V on each line for 240V since i live in USA. another thing i changed was the RCBO, instead i used 2 circuit breakers for each 120V line.
 
i followed this guide here, just changed the neutral line and hot line into 2 hot lines. 120V on each line for 240V since i live in USA. another thing i changed was the RCBO, instead i used 2 circuit breakers for each 120V line.
What are you using for the boom arm to hold the IR6000? That's the one thing preventing me from doing this project!
 
So the way i do this is use the existing PSU, but you will need - https://www.amazon.co.uk/VASI4KO-banana-plugs-crocodile-clips/dp/B004J6MX6U
or similiar types of lead.

The crocodile end clips onto the ps3 motherboard 12V pins and the other end the banana points push into the psu points. Then plug the 5v white lead also to the motherboard

Then you will need a multimeter to test the testpoints for the supplied voltage readings expected.
I must be a complete idiot! You would be shocked how long it took me to figure this out...
Probing.jpg

Cardboard and avoiding pads under the PSU was my previous method...lol! Now I just need to extend the 5V connector and I'll have room to work.

Sigh...we can't all be geniuses.
 
Sem001 board have that 5 pins cable double length,just a tip.
I've extended both half meter, it is hard to assembly every time for testing, so I test it on jig after reball.
 
I must be a complete idiot! You would be shocked how long it took me to figure this out...
View attachment 35592
Cardboard and avoiding pads under the PSU was my previous method...lol! Now I just need to extend the 5V connector and I'll have room to work.

Sigh...we can't all be geniuses.
I did the same when I realised I need live probing to find the real issue. But the length of cable and tilty mainboard bothered me. Not to mention a powerlet that dangling outside the PSU. So I 3d printed an adaptor for PSU and made some extension wires. Now I feel much faster every time I setup a probing session
FB31A506-7937-4149-AFA1-6A4B39AB6869.jpeg


68F3630F-4ADF-4621-A61A-55004BA97114.jpeg
 
Holy crap, is that what you get from the SB UART?

Man, it litterally breaks down exactly what step in the startup sequence it's initializing the HDMI transmitter. Kinda wierd that it referrs to it as a SiI9032 when it's actually a SiI9132, which is a confidential version of the SiI9134 (which you can find the data sheets for). It's similar as far as specs go, may be identical.

SiI9022 is the HDMI transmitter in the N64 Digital. It took me a minute to recall why seeing SiI9032 felt familiar! I reciently read that datasheet to calculate how far I could push the pixel clock using custom modelines on the SiI9022 (1920x1440p is the limit BTW = 184.75MHz pixel clock. 165MHz is max, so it's a mild overclock). That's the same max frequency as the SiI9132/4 in the PS3. So technically speaking the PS3 could support 1920x1440p with a mild overclock, if there was a way to use custom modelines.

I wonder if anyone has looked into that? Would be useful for 4:3 PS1/PS2 games (if your monitor supported the weired resolution). Of course, I'm not sure how much control developers have over the scaling config or firmware. The N64 Digital is purpose built with that in mind, I just thought it was neat to see a similar chip in the PS3 and wondered if it could be tweaked. It would at least be nice to have more control over post-processing besides smooth on/off.
It's just syscon uart output. Before bringup, type "hdmi vbs ffffffff", that will turn on all the verbose ouput for hdmi. Then bringup will show those hdmi debug messages.
 
Victor is correct. You don't need an oscilloscope to diagnose bad tokins. It can confirm they are bad and show your tantalum array is an adequate substitute, but it's not strictly needed. A 1002 error is what you're looking for. Resistance at VDDC is useful.

Oscilloscope is useful in checking clock signals are present and correct, PWM signals, laser calibration, ripple/noise attenuation, checking proper SYCN levels and etc. Any application where the voltage regularly changes frequency. Certainly a useful tool to have (a decient one anyway). Especially if you get into designing electronics. Real world measurements often differ from theoretical calculations due to parasitics on real hardware. Theory only get's you so far. A scope allow you to dial the design in. I recommend the RIGOL DS1054z. It's the best bang for your buck. Very capable 4-channel scope!

Hello Felix,

sorry for long time to reply.
I finally got my hands on RIGOL oscilloscope.
I measured the CPU VDDC during the bringup sequence.
The amplitude is 170mV... which is way above 50mV.

So.. I guess this definitely confirms a NEC/Tokin defect?
 
I did the same when I realised I need live probing to find the real issue. But the length of cable and tilty mainboard bothered me. Not to mention a powerlet that dangling outside the PSU. So I 3d printed an adaptor for PSU and made some extension wires. Now I feel much faster every time I setup a probing session
Any chance you can upload the STL/OBJ file so I can print one? I don't think the forum will allow it, but maybe you can put it up on thingiverse?
 
Hello Felix,

sorry for long time to reply.
I finally got my hands on RIGOL oscilloscope.
I measured the CPU VDDC during the bringup sequence.
The amplitude is 170mV... which is way above 50mV.

So.. I guess this definitely confirms a NEC/Tokin defect?
Yes that's correct.

Could you do some test before you replace the tokins? I'd like a good screen cap of the VDDC for both CPU and RSX.
test bench 1.jpg
test bench 2.jpg
You don't have to assemble the console and use RF shielding like I did. The point here is just to show how I propped up the probes during the test. Also it's really important to use ground springs!!! They cut down on the noise ALOT. Should have come with your scope. They really are needed to get good capture of the ripple.

First capture: Startup Behavior
  • CH1 (yellow probe) = CPU tokin output side
  • CH2 (Blue probe) = RSX tokin output side
  • Set trigger level at about 0.8V on channel 1 (CPU).
  • DC Coupling
  • Bandwidth Limit = 20MHz
  • Horizontal = 50ms.
  • Vertical = 50mV & 20mV
  • Acquire --> HiRes Mode
  • Measure --> Measure All.
    • Measure --> measure all --> measure all source --> check boxes for CH1 & CH2. This way it'll display measurements for both channels (CPU & RSX).
  • After triggering, move the voltages down (DC offset) so they both fit under the measurement box. A DC offset of around 1.1v -1.3v is what I found was needed to bring the voltage readings into view. The more you're zoomed in the more turns it takes of the rotary knob. Just pay attention to the DC offset, slow down when it gets close to -1v and the voltage should come into view. It's easier if you start zoomed out and move your way in close one step at a time. It will probably take a few triggers to get it dialed in. Play around until you get the hang of it.
startup-seq-hires-acq-png.31035
ps3_4_3-png.31037

Startup Behavior.png

White line is the plateau you want to zoom in on for the voltage ripple/noise measurment. see below...
Second capture: CPU/GPU Core Voltage Ripple & Noise
  • CH1 (yellow probe) = CPU tokin output side
  • CH2 (Blue probe) = RSX tokin output side
  • Move the horizontal position over to 300ms, or about the middle of the second to last voltage plateau. It's the point in the startup sequence I marked with a white line in the last picture above. Basically it's the voltage plateau before the console finishes the power on sequence. After that the GPU will start a 60Hz pattern, which I suspect is the frame buffer. We want to see the buck converter ripple before any real load is placed on the console, and most YLOD consoles make it this far into the power on sequence, so that's why I chose it for this measurement. The ripple here should be under 50mV MAX, but is typically 20mV with good tokins. But before you can measure it accurately, you need to zoom way in on the ripple...
  • So set Horizontal = 1us/div and Vertical = 50mV/div.
  • The measure all can be useful here, but the cursor is most accurate for the Vpp ripple. Play with the cursor function and figure out how to measure the peak-peak voltage using it. The Measure all window is convenient, but measures transient voltage spikes (noise) in the Vpp measurement. We want ripple voltage which is the P-P of the larger waveform, not the noise spikes.
rsx-bad-tokin-noise-dc-coupling-10x-probe-png.31034
cpu-bad-tokin-noise-dc-coupling-10x-probe-png.31032

The examples above are from PS3#7, a console with bad RSX tokins.
 
Last edited:
Well it looks like my 9th system may be fixable (just not by me) by a reflow or reball as I was messing with the clamps and managed to briefly get an image before it powered down with a YLOD.
 
Well it looks like my 9th system may be fixable (just not by me) by a reflow or reball as I was messing with the clamps and managed to briefly get an image before it powered down with a YLOD.
You're about to surpass me. I stopped buying new systems at #10.

I still fight the urge to check e-bay. Everytime I do I find a deal too good to pass up. I past up on one the other day that looked like a working A model for $40. That sick part of me said, "but what if?" NO...NO...NO! I had to stop. I told myself "they probably reflowed it!" Luckily they didn't show the bottom, where the warranty sticker was. If they had and it was intact, I'd have PS3#11 and no room for it!
 
Hi. I've been watch this thread for a while and thanks for all the work! I've got error codes from 3 of my boards(2 SEM-001, 1 DIA-001) successfully, which is great.

The DIA-001 board I've got is having 2031 and 2131 errors, according to error code guide it's a RSX thermal sensor(IC2101) error. The error log is:
Code:
>$ errlog
errlog
ofst[108]:err_code:0xffffffff, clock:0x28c08b6e  2021/08/31 06:40:46
ofst[112]:err_code:0xa0082131, clock:0x28c08b7a  2021/08/31 06:40:58
ofst[116]:err_code:0xa0902131, clock:0x28c08b7b  2021/08/31 06:40:59
ofst[120]:err_code:0xa0082131, clock:0x28c08b88  2021/08/31 06:41:12
ofst[124]:err_code:0xa0082131, clock:0x28c08b95  2021/08/31 06:41:25
ofst[  0]:err_code:0xa0902131, clock:0x28c08b95  2021/08/31 06:41:25
ofst[  4]:err_code:0xa0a02131, clock:0x28c08ba7  2021/08/31 06:41:43
ofst[  8]:err_code:0xa0a02031, clock:0x28c08ba7  2021/08/31 06:41:43
ofst[ 12]:err_code:0xa0a02031, clock:0x28c08ba7  2021/08/31 06:41:43
ofst[ 16]:err_code:0xa0a02031, clock:0x28c08ba7  2021/08/31 06:41:43
ofst[ 20]:err_code:0xa0a02031, clock:0x28c08ba7  2021/08/31 06:41:43
ofst[ 24]:err_code:0xa0a02031, clock:0x28c08ba7  2021/08/31 06:41:43
ofst[ 28]:err_code:0xa0a02031, clock:0x28c08ba7  2021/08/31 06:41:43
ofst[ 32]:err_code:0xa0082131, clock:0x28c08baa  2021/08/31 06:41:46
ofst[ 36]:err_code:0xa0902131, clock:0x28c08baa  2021/08/31 06:41:46
ofst[ 40]:err_code:0xa0082131, clock:0x28c08bb2  2021/08/31 06:41:54
ofst[ 44]:err_code:0xa0902131, clock:0x28c08bb2  2021/08/31 06:41:54
ofst[ 48]:err_code:0xa0082131, clock:0x28c08bc5  2021/08/31 06:42:13
ofst[ 52]:err_code:0xa0902131, clock:0x28c08bc5  2021/08/31 06:42:13
ofst[ 56]:err_code:0xa0082131, clock:0x28c08bd1  2021/08/31 06:42:25
ofst[ 60]:err_code:0xa0902131, clock:0x28c08bd1  2021/08/31 06:42:25
ofst[ 64]:err_code:0xa0a02131, clock:0xffffffff
ofst[ 68]:err_code:0xa0a02031, clock:0xffffffff
ofst[ 72]:err_code:0xa0a02131, clock:0xffffffff
ofst[ 76]:err_code:0xa0a02131, clock:0xffffffff
ofst[ 80]:err_code:0xa0a02131, clock:0xffffffff
ofst[ 84]:err_code:0xa0a02131, clock:0xffffffff
ofst[ 88]:err_code:0xa0082131, clock:0xffffffff
ofst[ 92]:err_code:0xa0a02131, clock:0xffffffff
ofst[ 96]:err_code:0xa0a02031, clock:0xffffffff
ofst[100]:err_code:0xa0a02031, clock:0xffffffff
ofst[104]:err_code:0xa0a02031, clock:0xffffffff
[mullion]$

And the bringup sequence isn't very interesting. It stops early:
Code:
>$ auth
Auth successful
>$ bringup
bringup
[SSM] state: 0000 -> 0101
Bringup Mode #0 (0xFF)
[SSM] ssmCb_OnStartingBePowOn() called.
[SSM] First Boot.
[SSM] Bringup mode : syspm_stat=00000000/00000000
[POWSEQ] PowerSeq_Setup called.
[SSM] state: 0101 -> 0301
[SSM] PowSeq Fail : Detected !
[SSM] state: 0301 -> 0700
[POWSEQ] AV Backend Letup
[SSM] Shutdown mode : syspm_stat=00000000/00000000
[ERROR]: 0xa0082131
[ERROR]: 0xa0902131
>$

Luckily on this DIA-001 I can find something wrong with two capacitors seems to be on the power rail of RSX
mHeb2x9

https://imgur.com/a/mHeb2x9

And according to the service manual, though not DIA-001, the thermal sensor for RSX should be IC2101. On https://www.psdevwiki.com/ps3/Thermal#RSX it says could be a OnSemi or Ti sensor. Later I found this little chip sitting next to RSX:
https://imgur.com/gallery/MThP4cT
MThP4cT


My question is, do I need to do any multi-meter for this thermal sensor checking before I order some replacement for the two leaky capcitors? If so, how? After all this is a thermal sensor error but could be well related to power issue. Thanks in advance!

Alright. I finally managed to fix this DIA-001. With the right tool to replace the thermal sensor IC, I can now confirm if you have 08 2131 accompanying with 90 2131, or 08 2031 accompanying with 90 2031, it's likely to be the RSX thermal sensor(IC2101) itself.

To be honest I wasn't sure at the beginning so the board has been shelved for a while. Later I did some live probing around the IC2101 and probably shorted some of the pins together. Before the live probing, the 2031 error I got was pretty late so it used to be a long YLOD. After the suspecting short, the YLOD became a instant one but the error code remains the same. In addition, I found the 3.3V thermal voltage is almost always on, that is, it's on when syscon started working but probably not generating any useful data because the RSX/CELL weren't turned on yet. So a half dead thermal IC might only generate errors after bringup a few seconds, but a totally dead thermal IC could generate errors instantly when bringup because the syscon probably already detected something wrong with it. All of these make me think the 2031/2131 error was indeed generated by the thermal sensor IC itself. To my surprise, I was right.
 
Yes that's correct.

Could you do some test before you replace the tokins? I'd like a good screen cap of the VDDC for both CPU and RSX.
You don't have to assemble the console and use RF shielding like I did. The point here is just to show how I propped up the probes during the test. Also it's really important to use ground springs!!! They cut down on the noise ALOT. Should have come with your scope. They really are needed to get good capture of the ripple.

First capture: Startup Behavior
  • CH1 (yellow probe) = CPU tokin output side
  • CH2 (Blue probe) = RSX tokin output side
  • Set trigger level at about 0.8V on channel 1 (CPU).
  • DC Coupling
  • Bandwidth Limit = 20MHz
  • Horizontal = 50ms.
  • Vertical = 50mV & 20mV
  • Acquire --> HiRes Mode
  • Measure --> Measure All.
    • Measure --> measure all --> measure all source --> check boxes for CH1 & CH2. This way it'll display measurements for both channels (CPU & RSX).
  • After triggering, move the voltages down (DC offset) so they both fit under the measurement box. A DC offset of around 1.1v -1.3v is what I found was needed to bring the voltage readings into view. The more you're zoomed in the more turns it takes of the rotary knob. Just pay attention to the DC offset, slow down when it gets close to -1v and the voltage should come into view. It's easier if you start zoomed out and move your way in close one step at a time. It will probably take a few triggers to get it dialed in. Play around until you get the hang of it.
startup-seq-hires-acq-png.31035
ps3_4_3-png.31037

View attachment 35614
White line is the plateau you want to zoom in on for the voltage ripple/noise measurment. see below...
Second capture: CPU/GPU Core Voltage Ripple & Noise
  • CH1 (yellow probe) = CPU tokin output side
  • CH2 (Blue probe) = RSX tokin output side
  • Move the horizontal position over to 300ms, or about the middle of the second to last voltage plateau. It's the point in the startup sequence I marked with a white line in the last picture above. Basically it's the voltage plateau before the console finishes the power on sequence. After that the GPU will start a 60Hz pattern, which I suspect is the frame buffer. We want to see the buck converter ripple before any real load is placed on the console, and most YLOD consoles make it this far into the power on sequence, so that's why I chose it for this measurement. The ripple here should be under 50mV MAX, but is typically 20mV with good tokins. But before you can measure it accurately, you need to zoom way in on the ripple...
  • So set Horizontal = 1us/div and Vertical = 50mV/div.
  • The measure all can be useful here, but the cursor is most accurate for the Vpp ripple. Play with the cursor function and figure out how to measure the peak-peak voltage using it. The Measure all window is convenient, but measures transient voltage spikes (noise) in the Vpp measurement. We want ripple voltage which is the P-P of the larger waveform, not the noise spikes.
rsx-bad-tokin-noise-dc-coupling-10x-probe-png.31034
cpu-bad-tokin-noise-dc-coupling-10x-probe-png.31032

The examples above are from PS3#7, a console with bad RSX tokins.



Hello Felix,

my measures from the "First capture: Startup Behavior" are different than those on your example.

See below.

1.jpeg
2.jpeg
3.jpeg
 
@RIP-Felix Well I have surpassed you then as I have foun that I have 12 PS3 systems from my friend (although one system was missing it's motherboard so I am not sure it counts.) Also have 4 other systems that I had previously before I got the extra systems from my friend ( 2 that work and 2 that don't).
 
Hello Felix,

my measures from the "First capture: Startup Behavior" are different than those on your example.

See below.

View attachment 35640 View attachment 35641 View attachment 35642
Okay, from what I can see your console is staying on for like 3 seconds before the YLOD. But you're only getting up to ~110mV on both CPU/RSX VDDC. That's confusing to me, because in every case I've seen the VDDC fail the console YLOD in less than 1.5 seconds.

I have a thought. Double check that your probes are set to 10x and the scope is set to 10x probes. If I multiply your voltage levels by ten it seems about right.

You are measuring at the tokins, yes? And do you have any of the tokins removed? Maybe a picture would be useful here.
 
Last edited:
Yes that's correct.

Could you do some test before you replace the tokins? I'd like a good screen cap of the VDDC for both CPU and RSX.
You don't have to assemble the console and use RF shielding like I did. The point here is just to show how I propped up the probes during the test. Also it's really important to use ground springs!!! They cut down on the noise ALOT. Should have come with your scope. They really are needed to get good capture of the ripple.

First capture: Startup Behavior
  • CH1 (yellow probe) = CPU tokin output side
  • CH2 (Blue probe) = RSX tokin output side
  • Set trigger level at about 0.8V on channel 1 (CPU).
  • DC Coupling
  • Bandwidth Limit = 20MHz
  • Horizontal = 50ms.
  • Vertical = 50mV & 20mV
  • Acquire --> HiRes Mode
  • Measure --> Measure All.
    • Measure --> measure all --> measure all source --> check boxes for CH1 & CH2. This way it'll display measurements for both channels (CPU & RSX).
  • After triggering, move the voltages down (DC offset) so they both fit under the measurement box. A DC offset of around 1.1v -1.3v is what I found was needed to bring the voltage readings into view. The more you're zoomed in the more turns it takes of the rotary knob. Just pay attention to the DC offset, slow down when it gets close to -1v and the voltage should come into view. It's easier if you start zoomed out and move your way in close one step at a time. It will probably take a few triggers to get it dialed in. Play around until you get the hang of it.
startup-seq-hires-acq-png.31035
ps3_4_3-png.31037

View attachment 35614
White line is the plateau you want to zoom in on for the voltage ripple/noise measurment. see below...
Second capture: CPU/GPU Core Voltage Ripple & Noise
  • CH1 (yellow probe) = CPU tokin output side
  • CH2 (Blue probe) = RSX tokin output side
  • Move the horizontal position over to 300ms, or about the middle of the second to last voltage plateau. It's the point in the startup sequence I marked with a white line in the last picture above. Basically it's the voltage plateau before the console finishes the power on sequence. After that the GPU will start a 60Hz pattern, which I suspect is the frame buffer. We want to see the buck converter ripple before any real load is placed on the console, and most YLOD consoles make it this far into the power on sequence, so that's why I chose it for this measurement. The ripple here should be under 50mV MAX, but is typically 20mV with good tokins. But before you can measure it accurately, you need to zoom way in on the ripple...
  • So set Horizontal = 1us/div and Vertical = 50mV/div.
  • The measure all can be useful here, but the cursor is most accurate for the Vpp ripple. Play with the cursor function and figure out how to measure the peak-peak voltage using it. The Measure all window is convenient, but measures transient voltage spikes (noise) in the Vpp measurement. We want ripple voltage which is the P-P of the larger waveform, not the noise spikes.
rsx-bad-tokin-noise-dc-coupling-10x-probe-png.31034
cpu-bad-tokin-noise-dc-coupling-10x-probe-png.31032

The examples above are from PS3#7, a console with bad RSX tokins.

About the second measurement "Second capture: CPU/GPU Core Voltage Ripple & Noise"
Here is where it gets interesting...
Notice the yellow probe (CPU tokins).
They look entirely different from standard capacitor charge-discarge cycle.
So perhaps... the CPU tokins are bad... not the RSX ones...


4.jpeg
5.jpeg
 
About the second measurement "Second capture: CPU/GPU Core Voltage Ripple & Noise"
Here is where it gets interesting...
Notice the yellow probe (CPU tokins).
They look entirely different from standard capacitor charge-discarge cycle.
So perhaps... the CPU tokins are bad... not the RSX ones...


View attachment 35645 View attachment 35646
Dang you're fast. I edited my previous post hoping you wouldn't read it before I did so. I realized my brain fart after posting.

Anyway double check that your probes and scope are set to 10x. The voltage level seems like a mismatch.

Nice scope BTW!
 
Dang you're fast. I edited my previous post hoping you wouldn't read it before I did so. I realized my brain fart after posting.

Anyway double check that your probes and scope are set to 10x. The voltage level seems like a mismatch.

Nice scope BTW!

Yeah, I had one probe set to 1X instead of 10X.

Here are the results when everything is set to 10X (probes and a scope).

PS. These tapes just hold the pins and provide some pressure on them.

6.jpeg
7.jpeg
8.jpeg
 
Yeah, I had one probe set to 1X instead of 10X.

Here are the results when everything is set to 10X (probes and a scope).

PS. These tapes just hold the pins and provide some pressure on them.

View attachment 35647 View attachment 35648 View attachment 35649
RSX tokins certainly have the bad waveform.

One thing I do know is that bad CPU tokins can affect RSX tokin ripple, but as bad as that looks and with your errors, it's clear all the tokins need to go!

Before I get concerned about your voltage levels, what model PS3 is that again? They are low for 90nm Cell/RSX. Perhaps it's normal for 65/40nm models. IDK, I don't work on them.

The CPU voltage reading being that flat does concern me. I think we should do some probing (carefully not to short any pins). Fill out the following voltage test worksheet using the jumper locations guide. It's a lot of work but will help rule out other possible issues.
Voltage Test Worksheet.JPG
Jumperrs COK-001 (Side A).jpg

Also, what is the resistance of the CPU and RSX tokins to GND?
 

Similar threads

Back
Top