Repair Chain (Markov Chain Sample Model)

The name of the pictureThe name of the pictureThe name of the pictureClash Royale CLAN TAG#URR8PPP











up vote
-2
down vote

favorite












A machine has $3$ critical parts that are subject to failure, but can function as long as two of these parts are working. When two are broken, they are replaced and the machine is back to working order the next day. To formulate a Markov chain model we declare its state space to be parts that are broken $0,1,2,3,12,13,23$. If we assume that parts $1,2$ and $ 3 $ fail with probabilities $0.01, 0.02,$ and $ 0.04$ ,respectively but no two parts fail at the same day, then we arrive at the following transition matrix.



$$
beginmatrix
& 0 & 1 & 2 &3 &12 &13 &23 \
0 & 0.93 & 0.01 & 0.02 &0.04 &0 &0 &0 \
1 & 0 &0.94 & 0 & 0 &0.02 &0.04 & 0 \
2 & 0 & 0 & 0.95 & 0 &0.01 &0 &0.04 \
3 & 0 & 0 & 0 &0.97 &0 &0.01 &0.02 \
12 & 1 & 0 & 0 &0 &0 &0 &0\
13 & 1 & 0 & 0 &0 &0 &0 &0\
23 & 1 & 0 & 0 &0 &0 &0 &0\
end
matrix$$



I don't have any problem with the interpretation of $p(0,0), p(0,1), p(0,2)$ and $p(0,3)$. It says there that given everything is working fine, there is $93$% chance everything will still be fine. $1$% of part $1$ failing, $2$% of part $2$ failing, and $4$% of part $3$ failing. What I don't get is everything underneath.







share|cite|improve this question



















  • Like for p(1,1), My interpretation is given part 1 already failed, 94% is the chance of what? Failing again?
    – maskleon
    Mar 12 '15 at 12:05











  • If in state 1, either part 2 fails and one goes to state 12, or part 3 fails and one goes to state 13, or neither part 2 nor part 3 fail and one stays in state 1. Likewise for every line of the transition matrix
    – Did
    Mar 12 '15 at 12:18










  • Thanks a lot, Did. Now, I get it.
    – maskleon
    Mar 12 '15 at 13:07










  • If in state 1, either part 2 fails and one goes to state 12, or part 3 fails and one goes to state 13, or neither part 2 nor part 3 fail and one stays in state 1. Likewise for every line of the transition matrix Could you explain this a bit more Did please?
    – Kan
    Aug 6 at 22:11














up vote
-2
down vote

favorite












A machine has $3$ critical parts that are subject to failure, but can function as long as two of these parts are working. When two are broken, they are replaced and the machine is back to working order the next day. To formulate a Markov chain model we declare its state space to be parts that are broken $0,1,2,3,12,13,23$. If we assume that parts $1,2$ and $ 3 $ fail with probabilities $0.01, 0.02,$ and $ 0.04$ ,respectively but no two parts fail at the same day, then we arrive at the following transition matrix.



$$
beginmatrix
& 0 & 1 & 2 &3 &12 &13 &23 \
0 & 0.93 & 0.01 & 0.02 &0.04 &0 &0 &0 \
1 & 0 &0.94 & 0 & 0 &0.02 &0.04 & 0 \
2 & 0 & 0 & 0.95 & 0 &0.01 &0 &0.04 \
3 & 0 & 0 & 0 &0.97 &0 &0.01 &0.02 \
12 & 1 & 0 & 0 &0 &0 &0 &0\
13 & 1 & 0 & 0 &0 &0 &0 &0\
23 & 1 & 0 & 0 &0 &0 &0 &0\
end
matrix$$



I don't have any problem with the interpretation of $p(0,0), p(0,1), p(0,2)$ and $p(0,3)$. It says there that given everything is working fine, there is $93$% chance everything will still be fine. $1$% of part $1$ failing, $2$% of part $2$ failing, and $4$% of part $3$ failing. What I don't get is everything underneath.







share|cite|improve this question



















  • Like for p(1,1), My interpretation is given part 1 already failed, 94% is the chance of what? Failing again?
    – maskleon
    Mar 12 '15 at 12:05











  • If in state 1, either part 2 fails and one goes to state 12, or part 3 fails and one goes to state 13, or neither part 2 nor part 3 fail and one stays in state 1. Likewise for every line of the transition matrix
    – Did
    Mar 12 '15 at 12:18










  • Thanks a lot, Did. Now, I get it.
    – maskleon
    Mar 12 '15 at 13:07










  • If in state 1, either part 2 fails and one goes to state 12, or part 3 fails and one goes to state 13, or neither part 2 nor part 3 fail and one stays in state 1. Likewise for every line of the transition matrix Could you explain this a bit more Did please?
    – Kan
    Aug 6 at 22:11












up vote
-2
down vote

favorite









up vote
-2
down vote

favorite











A machine has $3$ critical parts that are subject to failure, but can function as long as two of these parts are working. When two are broken, they are replaced and the machine is back to working order the next day. To formulate a Markov chain model we declare its state space to be parts that are broken $0,1,2,3,12,13,23$. If we assume that parts $1,2$ and $ 3 $ fail with probabilities $0.01, 0.02,$ and $ 0.04$ ,respectively but no two parts fail at the same day, then we arrive at the following transition matrix.



$$
beginmatrix
& 0 & 1 & 2 &3 &12 &13 &23 \
0 & 0.93 & 0.01 & 0.02 &0.04 &0 &0 &0 \
1 & 0 &0.94 & 0 & 0 &0.02 &0.04 & 0 \
2 & 0 & 0 & 0.95 & 0 &0.01 &0 &0.04 \
3 & 0 & 0 & 0 &0.97 &0 &0.01 &0.02 \
12 & 1 & 0 & 0 &0 &0 &0 &0\
13 & 1 & 0 & 0 &0 &0 &0 &0\
23 & 1 & 0 & 0 &0 &0 &0 &0\
end
matrix$$



I don't have any problem with the interpretation of $p(0,0), p(0,1), p(0,2)$ and $p(0,3)$. It says there that given everything is working fine, there is $93$% chance everything will still be fine. $1$% of part $1$ failing, $2$% of part $2$ failing, and $4$% of part $3$ failing. What I don't get is everything underneath.







share|cite|improve this question











A machine has $3$ critical parts that are subject to failure, but can function as long as two of these parts are working. When two are broken, they are replaced and the machine is back to working order the next day. To formulate a Markov chain model we declare its state space to be parts that are broken $0,1,2,3,12,13,23$. If we assume that parts $1,2$ and $ 3 $ fail with probabilities $0.01, 0.02,$ and $ 0.04$ ,respectively but no two parts fail at the same day, then we arrive at the following transition matrix.



$$
beginmatrix
& 0 & 1 & 2 &3 &12 &13 &23 \
0 & 0.93 & 0.01 & 0.02 &0.04 &0 &0 &0 \
1 & 0 &0.94 & 0 & 0 &0.02 &0.04 & 0 \
2 & 0 & 0 & 0.95 & 0 &0.01 &0 &0.04 \
3 & 0 & 0 & 0 &0.97 &0 &0.01 &0.02 \
12 & 1 & 0 & 0 &0 &0 &0 &0\
13 & 1 & 0 & 0 &0 &0 &0 &0\
23 & 1 & 0 & 0 &0 &0 &0 &0\
end
matrix$$



I don't have any problem with the interpretation of $p(0,0), p(0,1), p(0,2)$ and $p(0,3)$. It says there that given everything is working fine, there is $93$% chance everything will still be fine. $1$% of part $1$ failing, $2$% of part $2$ failing, and $4$% of part $3$ failing. What I don't get is everything underneath.









share|cite|improve this question










share|cite|improve this question




share|cite|improve this question









asked Mar 12 '15 at 12:02









maskleon

858




858











  • Like for p(1,1), My interpretation is given part 1 already failed, 94% is the chance of what? Failing again?
    – maskleon
    Mar 12 '15 at 12:05











  • If in state 1, either part 2 fails and one goes to state 12, or part 3 fails and one goes to state 13, or neither part 2 nor part 3 fail and one stays in state 1. Likewise for every line of the transition matrix
    – Did
    Mar 12 '15 at 12:18










  • Thanks a lot, Did. Now, I get it.
    – maskleon
    Mar 12 '15 at 13:07










  • If in state 1, either part 2 fails and one goes to state 12, or part 3 fails and one goes to state 13, or neither part 2 nor part 3 fail and one stays in state 1. Likewise for every line of the transition matrix Could you explain this a bit more Did please?
    – Kan
    Aug 6 at 22:11
















  • Like for p(1,1), My interpretation is given part 1 already failed, 94% is the chance of what? Failing again?
    – maskleon
    Mar 12 '15 at 12:05











  • If in state 1, either part 2 fails and one goes to state 12, or part 3 fails and one goes to state 13, or neither part 2 nor part 3 fail and one stays in state 1. Likewise for every line of the transition matrix
    – Did
    Mar 12 '15 at 12:18










  • Thanks a lot, Did. Now, I get it.
    – maskleon
    Mar 12 '15 at 13:07










  • If in state 1, either part 2 fails and one goes to state 12, or part 3 fails and one goes to state 13, or neither part 2 nor part 3 fail and one stays in state 1. Likewise for every line of the transition matrix Could you explain this a bit more Did please?
    – Kan
    Aug 6 at 22:11















Like for p(1,1), My interpretation is given part 1 already failed, 94% is the chance of what? Failing again?
– maskleon
Mar 12 '15 at 12:05





Like for p(1,1), My interpretation is given part 1 already failed, 94% is the chance of what? Failing again?
– maskleon
Mar 12 '15 at 12:05













If in state 1, either part 2 fails and one goes to state 12, or part 3 fails and one goes to state 13, or neither part 2 nor part 3 fail and one stays in state 1. Likewise for every line of the transition matrix
– Did
Mar 12 '15 at 12:18




If in state 1, either part 2 fails and one goes to state 12, or part 3 fails and one goes to state 13, or neither part 2 nor part 3 fail and one stays in state 1. Likewise for every line of the transition matrix
– Did
Mar 12 '15 at 12:18












Thanks a lot, Did. Now, I get it.
– maskleon
Mar 12 '15 at 13:07




Thanks a lot, Did. Now, I get it.
– maskleon
Mar 12 '15 at 13:07












If in state 1, either part 2 fails and one goes to state 12, or part 3 fails and one goes to state 13, or neither part 2 nor part 3 fail and one stays in state 1. Likewise for every line of the transition matrix Could you explain this a bit more Did please?
– Kan
Aug 6 at 22:11




If in state 1, either part 2 fails and one goes to state 12, or part 3 fails and one goes to state 13, or neither part 2 nor part 3 fail and one stays in state 1. Likewise for every line of the transition matrix Could you explain this a bit more Did please?
– Kan
Aug 6 at 22:11










1 Answer
1






active

oldest

votes

















up vote
0
down vote













First, I am going to relabel your states to that the indexing can work a little more consistently (this isn't really necessary, but it helps me work through the problem):



  1. Everything is in working order.

  2. Only Part 1 is broken.

  3. Only Part 2 is broken.

  4. Only Part 3 is broken.

  5. Parts 1 and 2 are broken.

  6. Parts 1 and 3 are broken.

  7. Parts 2 and 3 are broken.

The transition matrix $A$ is given by
$$A =
beginpmatrix
0.93 & 0.01 & 0.02 &0.04 &colorblue0 &colorblue0 &colorblue0 \
0 &0.94 & 0 & 0 &colorpurple0.02 &0.04 & 0 \
0 & 0 & 0.95 & 0 &0.01 &0 &0.04 \
0 & 0 & 0 &0.97 &0 &0.01 &0.02 \
colorred1 & 0 & 0 &0 &0 &0 &0\
colorred1 & 0 & 0 &0 &0 &0 &0\
colorred1 & 0 & 0 &0 &0 &0 &0\
endpmatrix.$$
Then $a_i,j$, the element of $A$ in the $i$-th row and $j$-th column, is the probability of transitioning from state $i$ into state $j$. For example, $colorpurplea_2,5 = 0.02$ (in purple) is the probability of transitioning from state 2 (only part 1 is broken) to state 5 (both parts 1 and 2 are broken). In other words, if part 1 is already broken on a given day, then $a_2,5$ is the probability that part 2 breaks down on the next day.



A couple of key points to think about:



  • Note that $colorbluea_1,j = 0$ for $j=4,5,6$ (these are the blue entries). This makes sense, as these three entries give the probability of transitioning from state 1 (everything is working fine) to a state where two parts are broken. In the statement of the problem, it is asserted that two parts cannot fail on the same day, thus the probability of going from "everything's fine!" to "two parts are broken!" is zero.

  • Next, note that $colorreda_i,1 = 1$ for $i=4,5,6$ (these are the red entries). Again, this makes sense. These three entries denote the probability of going from "two parts are broken" to "everything is fine". Since the machine is fixed whenever two parts break, the only possible transition out of "two parts are broken" is into a working state. Thus if two parts are broken, there is a 100% probability of transitioning to state 1 (everything's fine!)

  • Can you reason about the remaining entries?





share|cite|improve this answer























    Your Answer




    StackExchange.ifUsing("editor", function ()
    return StackExchange.using("mathjaxEditing", function ()
    StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix)
    StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
    );
    );
    , "mathjax-editing");

    StackExchange.ready(function()
    var channelOptions =
    tags: "".split(" "),
    id: "69"
    ;
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function()
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled)
    StackExchange.using("snippets", function()
    createEditor();
    );

    else
    createEditor();

    );

    function createEditor()
    StackExchange.prepareEditor(
    heartbeatType: 'answer',
    convertImagesToLinks: true,
    noModals: false,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    noCode: true, onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    );



    );








     

    draft saved


    draft discarded


















    StackExchange.ready(
    function ()
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f1186714%2frepair-chain-markov-chain-sample-model%23new-answer', 'question_page');

    );

    Post as a guest






























    1 Answer
    1






    active

    oldest

    votes








    1 Answer
    1






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes








    up vote
    0
    down vote













    First, I am going to relabel your states to that the indexing can work a little more consistently (this isn't really necessary, but it helps me work through the problem):



    1. Everything is in working order.

    2. Only Part 1 is broken.

    3. Only Part 2 is broken.

    4. Only Part 3 is broken.

    5. Parts 1 and 2 are broken.

    6. Parts 1 and 3 are broken.

    7. Parts 2 and 3 are broken.

    The transition matrix $A$ is given by
    $$A =
    beginpmatrix
    0.93 & 0.01 & 0.02 &0.04 &colorblue0 &colorblue0 &colorblue0 \
    0 &0.94 & 0 & 0 &colorpurple0.02 &0.04 & 0 \
    0 & 0 & 0.95 & 0 &0.01 &0 &0.04 \
    0 & 0 & 0 &0.97 &0 &0.01 &0.02 \
    colorred1 & 0 & 0 &0 &0 &0 &0\
    colorred1 & 0 & 0 &0 &0 &0 &0\
    colorred1 & 0 & 0 &0 &0 &0 &0\
    endpmatrix.$$
    Then $a_i,j$, the element of $A$ in the $i$-th row and $j$-th column, is the probability of transitioning from state $i$ into state $j$. For example, $colorpurplea_2,5 = 0.02$ (in purple) is the probability of transitioning from state 2 (only part 1 is broken) to state 5 (both parts 1 and 2 are broken). In other words, if part 1 is already broken on a given day, then $a_2,5$ is the probability that part 2 breaks down on the next day.



    A couple of key points to think about:



    • Note that $colorbluea_1,j = 0$ for $j=4,5,6$ (these are the blue entries). This makes sense, as these three entries give the probability of transitioning from state 1 (everything is working fine) to a state where two parts are broken. In the statement of the problem, it is asserted that two parts cannot fail on the same day, thus the probability of going from "everything's fine!" to "two parts are broken!" is zero.

    • Next, note that $colorreda_i,1 = 1$ for $i=4,5,6$ (these are the red entries). Again, this makes sense. These three entries denote the probability of going from "two parts are broken" to "everything is fine". Since the machine is fixed whenever two parts break, the only possible transition out of "two parts are broken" is into a working state. Thus if two parts are broken, there is a 100% probability of transitioning to state 1 (everything's fine!)

    • Can you reason about the remaining entries?





    share|cite|improve this answer



























      up vote
      0
      down vote













      First, I am going to relabel your states to that the indexing can work a little more consistently (this isn't really necessary, but it helps me work through the problem):



      1. Everything is in working order.

      2. Only Part 1 is broken.

      3. Only Part 2 is broken.

      4. Only Part 3 is broken.

      5. Parts 1 and 2 are broken.

      6. Parts 1 and 3 are broken.

      7. Parts 2 and 3 are broken.

      The transition matrix $A$ is given by
      $$A =
      beginpmatrix
      0.93 & 0.01 & 0.02 &0.04 &colorblue0 &colorblue0 &colorblue0 \
      0 &0.94 & 0 & 0 &colorpurple0.02 &0.04 & 0 \
      0 & 0 & 0.95 & 0 &0.01 &0 &0.04 \
      0 & 0 & 0 &0.97 &0 &0.01 &0.02 \
      colorred1 & 0 & 0 &0 &0 &0 &0\
      colorred1 & 0 & 0 &0 &0 &0 &0\
      colorred1 & 0 & 0 &0 &0 &0 &0\
      endpmatrix.$$
      Then $a_i,j$, the element of $A$ in the $i$-th row and $j$-th column, is the probability of transitioning from state $i$ into state $j$. For example, $colorpurplea_2,5 = 0.02$ (in purple) is the probability of transitioning from state 2 (only part 1 is broken) to state 5 (both parts 1 and 2 are broken). In other words, if part 1 is already broken on a given day, then $a_2,5$ is the probability that part 2 breaks down on the next day.



      A couple of key points to think about:



      • Note that $colorbluea_1,j = 0$ for $j=4,5,6$ (these are the blue entries). This makes sense, as these three entries give the probability of transitioning from state 1 (everything is working fine) to a state where two parts are broken. In the statement of the problem, it is asserted that two parts cannot fail on the same day, thus the probability of going from "everything's fine!" to "two parts are broken!" is zero.

      • Next, note that $colorreda_i,1 = 1$ for $i=4,5,6$ (these are the red entries). Again, this makes sense. These three entries denote the probability of going from "two parts are broken" to "everything is fine". Since the machine is fixed whenever two parts break, the only possible transition out of "two parts are broken" is into a working state. Thus if two parts are broken, there is a 100% probability of transitioning to state 1 (everything's fine!)

      • Can you reason about the remaining entries?





      share|cite|improve this answer

























        up vote
        0
        down vote










        up vote
        0
        down vote









        First, I am going to relabel your states to that the indexing can work a little more consistently (this isn't really necessary, but it helps me work through the problem):



        1. Everything is in working order.

        2. Only Part 1 is broken.

        3. Only Part 2 is broken.

        4. Only Part 3 is broken.

        5. Parts 1 and 2 are broken.

        6. Parts 1 and 3 are broken.

        7. Parts 2 and 3 are broken.

        The transition matrix $A$ is given by
        $$A =
        beginpmatrix
        0.93 & 0.01 & 0.02 &0.04 &colorblue0 &colorblue0 &colorblue0 \
        0 &0.94 & 0 & 0 &colorpurple0.02 &0.04 & 0 \
        0 & 0 & 0.95 & 0 &0.01 &0 &0.04 \
        0 & 0 & 0 &0.97 &0 &0.01 &0.02 \
        colorred1 & 0 & 0 &0 &0 &0 &0\
        colorred1 & 0 & 0 &0 &0 &0 &0\
        colorred1 & 0 & 0 &0 &0 &0 &0\
        endpmatrix.$$
        Then $a_i,j$, the element of $A$ in the $i$-th row and $j$-th column, is the probability of transitioning from state $i$ into state $j$. For example, $colorpurplea_2,5 = 0.02$ (in purple) is the probability of transitioning from state 2 (only part 1 is broken) to state 5 (both parts 1 and 2 are broken). In other words, if part 1 is already broken on a given day, then $a_2,5$ is the probability that part 2 breaks down on the next day.



        A couple of key points to think about:



        • Note that $colorbluea_1,j = 0$ for $j=4,5,6$ (these are the blue entries). This makes sense, as these three entries give the probability of transitioning from state 1 (everything is working fine) to a state where two parts are broken. In the statement of the problem, it is asserted that two parts cannot fail on the same day, thus the probability of going from "everything's fine!" to "two parts are broken!" is zero.

        • Next, note that $colorreda_i,1 = 1$ for $i=4,5,6$ (these are the red entries). Again, this makes sense. These three entries denote the probability of going from "two parts are broken" to "everything is fine". Since the machine is fixed whenever two parts break, the only possible transition out of "two parts are broken" is into a working state. Thus if two parts are broken, there is a 100% probability of transitioning to state 1 (everything's fine!)

        • Can you reason about the remaining entries?





        share|cite|improve this answer















        First, I am going to relabel your states to that the indexing can work a little more consistently (this isn't really necessary, but it helps me work through the problem):



        1. Everything is in working order.

        2. Only Part 1 is broken.

        3. Only Part 2 is broken.

        4. Only Part 3 is broken.

        5. Parts 1 and 2 are broken.

        6. Parts 1 and 3 are broken.

        7. Parts 2 and 3 are broken.

        The transition matrix $A$ is given by
        $$A =
        beginpmatrix
        0.93 & 0.01 & 0.02 &0.04 &colorblue0 &colorblue0 &colorblue0 \
        0 &0.94 & 0 & 0 &colorpurple0.02 &0.04 & 0 \
        0 & 0 & 0.95 & 0 &0.01 &0 &0.04 \
        0 & 0 & 0 &0.97 &0 &0.01 &0.02 \
        colorred1 & 0 & 0 &0 &0 &0 &0\
        colorred1 & 0 & 0 &0 &0 &0 &0\
        colorred1 & 0 & 0 &0 &0 &0 &0\
        endpmatrix.$$
        Then $a_i,j$, the element of $A$ in the $i$-th row and $j$-th column, is the probability of transitioning from state $i$ into state $j$. For example, $colorpurplea_2,5 = 0.02$ (in purple) is the probability of transitioning from state 2 (only part 1 is broken) to state 5 (both parts 1 and 2 are broken). In other words, if part 1 is already broken on a given day, then $a_2,5$ is the probability that part 2 breaks down on the next day.



        A couple of key points to think about:



        • Note that $colorbluea_1,j = 0$ for $j=4,5,6$ (these are the blue entries). This makes sense, as these three entries give the probability of transitioning from state 1 (everything is working fine) to a state where two parts are broken. In the statement of the problem, it is asserted that two parts cannot fail on the same day, thus the probability of going from "everything's fine!" to "two parts are broken!" is zero.

        • Next, note that $colorreda_i,1 = 1$ for $i=4,5,6$ (these are the red entries). Again, this makes sense. These three entries denote the probability of going from "two parts are broken" to "everything is fine". Since the machine is fixed whenever two parts break, the only possible transition out of "two parts are broken" is into a working state. Thus if two parts are broken, there is a 100% probability of transitioning to state 1 (everything's fine!)

        • Can you reason about the remaining entries?






        share|cite|improve this answer















        share|cite|improve this answer



        share|cite|improve this answer








        edited Aug 8 at 1:32


























        answered Aug 8 at 1:24









        Xander Henderson

        13.1k83150




        13.1k83150






















             

            draft saved


            draft discarded


























             


            draft saved


            draft discarded














            StackExchange.ready(
            function ()
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f1186714%2frepair-chain-markov-chain-sample-model%23new-answer', 'question_page');

            );

            Post as a guest













































































            Comments

            Popular posts from this blog

            What is the equation of a 3D cone with generalised tilt?

            Color the edges and diagonals of a regular polygon

            Relationship between determinant of matrix and determinant of adjoint?