# Algorithms: low-level interface¶

Once we have data for GST, there are several algorithms we can run on it to produce tomographic estimates. Depending on the amount of data you have, and time available for running Gate Set Tomography, one algorithm may be preferable over the others. What is typically thought of as "standard GST" is the iterative maximum-likelihood optimization implemented by do_iterative_mlgst which uses a combination of minimum-$\chi^2$ GST and maximum-likelihood GST.

pygsti provides support for the following "primary" GST algorithms:

• Linear Gate Set Tomography (LGST): Uses short gate sequences to quickly compute a rough (low accuracy) estimate of a gate set by linear inversion.

• Extended Linear Gate Set Tomography (eLGST or EXLGST): Minimizes the sub-of-squared errors between independent LGST estimates and the estimates obtained from a single gate set to find a best-estimate gate set. This is typically done in an interative fashion, using LGST estimates for longer and longer sequences.

• Minimum-$\chi^2$ Gate Set Tomography (MC2GST): Minimizes the $\chi^{2}$ statistic of the data frequencies and gate set probabilities to find a best-estimate gate set. Typically done in an interative fashion, using successively larger sets of longer and longer gate sequences.

• Maximum-Likelihood Gate Set Tomography (MLGST): Maximizes the log-likelihood statistic of the data frequencies and gate set probabilities to find a best-estimate gate set. Typically done in an interative fashion similar to MC2GST. This maximum likelihood estimation (MLE) is very well-motivated from a statistics standpoint and should be the most accurate among the algorithms.

If you're curious, the implementation of the algorithms for LGST, EXLGST, MC2GST, and MLGST may be found in the pygsti.algorithms.core module. In this tutorial, we'll show how to invoke each of these algorithms.

Additionally, pygsti contains gauge-optimization algorithms. Because the outcome data (the input to the GST algorithms above) only determines a gate set up to some number of un-physical "gauge" degrees of freedom, it is often desirable to optimize the GateSet estimate obtained from a GST algorithm within the space of its gauge freedoms. This process is called "gauge-optimization" and the final part of this tutorial demonstrates how to gauge-optimize a gate set using various criteria.

## Primary GST Algorithms¶

The ingredients needed to as input to the "primary" GST algorithms are:

• a "target" GateSet which defines the desired gates. This gate set is used by LGST to specify the various gate, state preparation, POVM effect, and SPAM labels, as well as to provide an initial guess for the gauge degrees of freedom.
• a DataSet containing the data that GST attempts to fit using the probabilities generated by a single GateSet. This data set must at least contain the data for the gate sequences required by the algorithm that is chosen.
• for EXLGST, MC2GST, and MLGST, a list-of-lists of GateString objects, which specify which gate strings are used during each iteration of the algorithm (the length of the top-level list defines the number of interations). Note that which gate strings are included in these lists is different for EXLGST than it is for MC2GST and MLGST.
In :
from __future__ import print_function

In :
import pygsti
import json

/usr/local/lib/python3.6/site-packages/pyGSTi-0.9.4.4-py3.6.egg/pygsti/tools/matrixtools.py:23: UserWarning: Could not import Cython extension - falling back to slower pure-python routines
_warnings.warn("Could not import Cython extension - falling back to slower pure-python routines")

In :
#We'll use the standard I, X(pi/2), Y(pi/2) gate set that we generated data for in the DataSet tutorial
from pygsti.construction import std1Q_XYI

gs_target = std1Q_XYI.gs_target
prep_fiducials = std1Q_XYI.prepStrs
meas_fiducials = std1Q_XYI.effectStrs
germs = std1Q_XYI.germs

maxLengthList = [1,2,4,8,16] #for use in iterative algorithms

depol_gateset = gs_target.depolarize(gate_noise=0.1)

print("Loaded target gateset with gate labels: ", gs_target.gates.keys())
print("Loaded fiducial lists of lengths: ", (len(prep_fiducials),len(meas_fiducials)))
print("Loaded dataset of length: ", len(ds))

Cache file not found or is tool old -- one willbe created after loading is completed

---------------------------------------
FileNotFoundErrorTraceback (most recent call last)
49         # a saved Dataset object is ok
51     except:

/usr/local/lib/python3.6/site-packages/pyGSTi-0.9.4.4-py3.6.egg/pygsti/objects/dataset.py in __init__(self, oliData, timeData, repData, gateStrings, gateStringIndices, outcomeLabels, outcomeLabelIndices, bStatic, fileToLoadFrom, collisionAction, comment)
487                    and outcomeLabels is None and outcomeLabelIndices is None)
489             return

1443             else:
-> 1444                 f = open(fileOrFilename,"rb")
1445         else:

FileNotFoundError: [Errno 2] No such file or directory: 'tutorial_files/Example_Dataset.txt'

During handling of the above exception, another exception occurred:

FileNotFoundErrorTraceback (most recent call last)
<ipython-input-4-1cf151630610> in <module>()
9 maxLengthList = [1,2,4,8,16] #for use in iterative algorithms
10
---> 11 ds = pygsti.io.load_dataset("tutorial_files/Example_Dataset.txt", cache=True)
13

72             parser = _stdinput.StdInputParser()
73             ds = parser.parse_datafile(filename, bToStdout,
---> 74                                        collisionAction=collisionAction)
75
76             printer.log("Writing cache file (to speed future loads): %s"

/usr/local/lib/python3.6/site-packages/pyGSTi-0.9.4.4-py3.6.egg/pygsti/io/stdinput.py in parse_datafile(self, filename, showProgress, collisionAction)
245         preamble_directives = { }
--> 247         with open(filename, 'r') as datafile:
248             for line in datafile:
249                 line = line.strip()

FileNotFoundError: [Errno 2] No such file or directory: 'tutorial_files/Example_Dataset.txt'

### Using LGST to get an initial estimate¶

An important and distinguising property of the LGST algorithm is that it does not require an initial-guess GateSet as an input. It uses linear inversion and short sequences to obtain a rough gate set estimate. As such, it is very common to use the LGST estimate as the initial-guess starting point for more advanced forms of GST.

In :
#Run LGST to get an initial estimate for the gates in gs_target based on the data in ds

#run LGST
gs_lgst = pygsti.do_lgst(ds, prep_fiducials, meas_fiducials, targetGateset=gs_target, verbosity=1)

#Gauge optimize the result to match the target gateset
gs_lgst_after_gauge_opt = pygsti.gaugeopt_to_target(gs_lgst, gs_target, verbosity=1)

#Contract the result to CPTP, guaranteeing that the gates are CPTP
gs_clgst = pygsti.contract(gs_lgst_after_gauge_opt, "CPTP", verbosity=1)

---------------------------------------
NameErrorTraceback (most recent call last)
<ipython-input-1-935b2c11ef54> in <module>()
2
3 #run LGST
----> 4 gs_lgst = pygsti.do_lgst(ds, prep_fiducials, meas_fiducials, targetGateset=gs_target, verbosity=1)
5
6 #Gauge optimize the result to match the target gateset

NameError: name 'pygsti' is not defined
In :
print(gs_lgst)

rho0 =    0.7071  -0.0302   0.0396   0.7480

Mdefault = Unconstrained POVM with effect vectors:
0:
0.73
0
0
0.65

1:
0.69
0
0
-0.65

Gi =
1.0000        0        0        0
0.0094   0.9238   0.0542  -0.0155
0.0285  -0.0149   0.9021   0.0200
-0.0142   0.0280   0.0009   0.9057

Gx =
1.0000        0        0        0
0.0064   0.9053   0.0281  -0.0044
-0.0006   0.0215  -0.0471  -0.9983
-0.0692  -0.0056   0.8095   0.0090

Gy =
1.0000        0        0        0
-0.0152  -0.0245   0.0379   0.9906
0.0076  -0.0126   0.8876  -0.0257
-0.0771  -0.8084  -0.0476   0.0210



### Extended LGST (eLGST or EXLGST)¶

EXLGST requires a list-of-lists of gate strings, one per iteration. The elements of these lists are typically repetitions of short "germ" strings such that the final strings does not exceed some maximum length. We created such lists in the gate string tutorial. Now, we just load these lists from the text files they were saved in.

In :
#Get rho and E specifiers, needed by LGST
elgstListOfLists = pygsti.construction.make_elgst_lists(gs_target, germs, maxLengthList)

#run EXLGST.  The result, gs_exlgst, is a GateSet containing the estimated quantities
gs_exlgst = pygsti.do_iterative_exlgst(ds, gs_clgst, prep_fiducials, meas_fiducials, elgstListOfLists,
targetGateset=gs_target, verbosity=2)

--- Iterative eLGST:  Iter 5 of 5 ; 43 gate strings ---:


### Minimum-$\chi^2$ GST (MC2GST)¶

MC2GST and MLGST also require a list-of-lists of gate strings, one per iteration. However, the elements of these lists are typically repetitions of short "germ" strings sandwiched between fiducial strings such that the repeated-germ part of the string does not exceed some maximum length. We created such lists in the gate string tutorial. Now, we just load these lists from the text files they were saved in.

In :
#Get lists of gate strings for successive iterations of LSGST to use
lsgstListOfLists = pygsti.construction.make_lsgst_lists(gs_target, prep_fiducials, meas_fiducials, germs, maxLengthList)

#run MC2GST.  The result is a GateSet containing the estimated quantities
gs_mc2 = pygsti.do_iterative_mc2gst(ds, gs_clgst, lsgstListOfLists, verbosity=2)

--- Iterative MC2GST: Iter 1 of 5  92 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 40.9959 (92 data params - 44 model params = expected mean of 48; p-value = 0.752997)
Completed in 0.1s
Iteration 1 took 0.1s

--- Iterative MC2GST: Iter 2 of 5  168 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 119.003 (168 data params - 44 model params = expected mean of 124; p-value = 0.609957)
Completed in 0.2s
Iteration 2 took 0.2s

--- Iterative MC2GST: Iter 3 of 5  450 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 415.116 (450 data params - 44 model params = expected mean of 406; p-value = 0.366587)
Completed in 0.5s
Iteration 3 took 0.5s

--- Iterative MC2GST: Iter 4 of 5  862 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 813.352 (862 data params - 44 model params = expected mean of 818; p-value = 0.539288)
Completed in 1.0s
Iteration 4 took 1.0s

--- Iterative MC2GST: Iter 5 of 5  1282 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 1251.63 (1282 data params - 44 model params = expected mean of 1238; p-value = 0.387312)
Completed in 1.5s
Iteration 5 took 1.5s

Iterative MC2GST Total Time: 3.3s

In :
#Write the resulting EXLGST and MC2GST results to gate set text files for later reference.
pygsti.io.write_gateset(gs_exlgst, "tutorial_files/Example_eLGST_Gateset.txt","# Example result from running eLGST")
pygsti.io.write_gateset(gs_mc2,  "tutorial_files/Example_MC2GST_Gateset.txt","# Example result from running MC2GST")

In :
#Run MC2GST again but use a DataSet with a lower number of counts
gs_mc2_lowcnts = pygsti.do_iterative_mc2gst(dsLowCounts, gs_clgst, lsgstListOfLists, verbosity=2)

--- Iterative MC2GST: Iter 1 of 5  92 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 47.3001 (92 data params - 44 model params = expected mean of 48; p-value = 0.501435)
Completed in 0.1s
Iteration 1 took 0.2s

--- Iterative MC2GST: Iter 2 of 5  168 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 148.438 (168 data params - 44 model params = expected mean of 124; p-value = 0.0665627)
Completed in 0.3s
Iteration 2 took 0.3s

--- Iterative MC2GST: Iter 3 of 5  450 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 438.226 (450 data params - 44 model params = expected mean of 406; p-value = 0.130175)
Completed in 0.5s
Iteration 3 took 0.6s

--- Iterative MC2GST: Iter 4 of 5  862 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 836.618 (862 data params - 44 model params = expected mean of 818; p-value = 0.318)
Completed in 1.1s
Iteration 4 took 1.2s

--- Iterative MC2GST: Iter 5 of 5  1282 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 1267.98 (1282 data params - 44 model params = expected mean of 1238; p-value = 0.270572)
Completed in 1.6s
Iteration 5 took 1.6s

Iterative MC2GST Total Time: 3.8s


### Maximum Likelihood GST (MLGST)¶

Executing MLGST is very similar to MC2GST: the same gate string lists can be used and calling syntax is nearly identitcal.

In :
#run MLGST.  The result is a GateSet containing the estimated quantities
gs_mle = pygsti.do_iterative_mlgst(ds, gs_clgst, lsgstListOfLists, verbosity=2)

--- Iterative MLGST: Iter 1 of 5  92 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 40.9959 (92 data params - 44 model params = expected mean of 48; p-value = 0.752997)
Completed in 0.2s
2*Delta(log(L)) = 41.1735
Iteration 1 took 0.2s

--- Iterative MLGST: Iter 2 of 5  168 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 119.003 (168 data params - 44 model params = expected mean of 124; p-value = 0.609957)
Completed in 0.3s
2*Delta(log(L)) = 119.399
Iteration 2 took 0.4s

--- Iterative MLGST: Iter 3 of 5  450 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 415.116 (450 data params - 44 model params = expected mean of 406; p-value = 0.366587)
Completed in 0.6s
2*Delta(log(L)) = 415.822
Iteration 3 took 1.0s

--- Iterative MLGST: Iter 4 of 5  862 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 813.352 (862 data params - 44 model params = expected mean of 818; p-value = 0.539288)
Completed in 1.0s
2*Delta(log(L)) = 815.138
Iteration 4 took 1.7s

--- Iterative MLGST: Iter 5 of 5  1282 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 1251.63 (1282 data params - 44 model params = expected mean of 1238; p-value = 0.387312)
Completed in 1.9s
2*Delta(log(L)) = 1254.02
Iteration 5 took 2.9s

Switching to ML objective (last iteration)
--- MLGST ---
Maximum log(L) = 626.828 below upper bound of -2.13594e+06
2*Delta(log(L)) = 1253.66 (1282 data params - 44 model params = expected mean of 1238; p-value = 0.371952)
Completed in 2.2s
2*Delta(log(L)) = 1253.66
Final MLGST took 2.2s

Iterative MLGST Total Time: 8.5s

In :
#Run MLGST again but use a DataSet with a lower number of counts
gs_mle_lowcnts = pygsti.do_iterative_mlgst(dsLowCounts, gs_clgst, lsgstListOfLists, verbosity=2)

--- Iterative MLGST: Iter 1 of 5  92 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 47.3001 (92 data params - 44 model params = expected mean of 48; p-value = 0.501435)
Completed in 0.1s
2*Delta(log(L)) = 48.1797
Iteration 1 took 0.2s

--- Iterative MLGST: Iter 2 of 5  168 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 148.438 (168 data params - 44 model params = expected mean of 124; p-value = 0.0665627)
Completed in 0.3s
2*Delta(log(L)) = 152.737
Iteration 2 took 0.4s

--- Iterative MLGST: Iter 3 of 5  450 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 438.226 (450 data params - 44 model params = expected mean of 406; p-value = 0.130175)
Completed in 0.5s
2*Delta(log(L)) = 449.554
Iteration 3 took 0.8s

--- Iterative MLGST: Iter 4 of 5  862 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 836.618 (862 data params - 44 model params = expected mean of 818; p-value = 0.318)
Completed in 1.2s
2*Delta(log(L)) = 856.236
Iteration 4 took 1.8s

--- Iterative MLGST: Iter 5 of 5  1282 gate strings ---:
--- Minimum Chi^2 GST ---
Sum of Chi^2 = 1267.98 (1282 data params - 44 model params = expected mean of 1238; p-value = 0.270572)
Completed in 1.9s
2*Delta(log(L)) = 1296.65
Iteration 5 took 3.3s

Switching to ML objective (last iteration)
--- MLGST ---
Maximum log(L) = 644.501 below upper bound of -106241
2*Delta(log(L)) = 1289 (1282 data params - 44 model params = expected mean of 1238; p-value = 0.152777)
Completed in 2.0s
2*Delta(log(L)) = 1289
Final MLGST took 2.0s

Iterative MLGST Total Time: 8.6s


## Gauge Optimization¶

All gauge optimization algorithms perform essentially the same task - to find the gate set which optimizes some objective function from within the set or space of gate sets that are gauge-equivalent to some starting set. This is accomplished in pygsti using the following mechanism:

• one begins with an initial GateSet, call it gs, to be gauge-optimized.
• a pygsti.objects.GaugeGroup instance defines a parameterized group of allowable gauge transformations. This gauge group must be compatible with the gs's parameterization, so that gs.transform (which calls Gate.transform and SPAMVec.transform) is able to process elements of the GaugeGroup (obtained via a call to GaugeGroup.get_element(params)). That is, the gauge transformation must map between gatesets with the same parameterization (that give by gs). Because of the close interplay between a gate set's parameterization and its allowed gauge transformations, GateSet objects can contain a GaugeGroup instance as their default_gauge_group member. In many circumstances, gs.default_gauge_group is set to the correct gauge group to use for a given GateSet.
• pygsti.gaugeopt_custom(...) takes an intial GateSet, an objective function, and a GaugeGroup (along with other optimization parameters) and returns a gauge-optimized GateSet. Note that if its gauge_group argument is left as None, then the gate set's default gauge group is used. And objective function which takes a single GateSet argument and returns a float can be supplied, giving the user a fair amount of flexiblity.
• since usually the objective function is one which compares the gate set being optimized to a fixed "target" gate set, pygsti.gaugeopt_to_target(...) is a routine able to perform these common types of gauge optimization. Instead of an objective function, gaugeopt_to_target takes a target GateSet and additional arguments (see below) from which it constructs a objective function and then calls gaugeopt_custom. It is essetially a convenience routine for constructing common gauge optimization objective functions. Relevant arguments which affect what objective function is used are:
• targetGateset : the GateSet to compare against - i.e., the one you want to gauge optimize toward. Note that this doesn't have to be a set of ideal gates - it can be any (imperfect) gate set that reflects your expectations about what the estimates should look like.
• itemWeights : a dictionary of weights allowing different gates and/or SPAM operations to be weighted differently when computing the objective function's value.
• CPpenalty : a prefactor multiplying the sum of all the negative Choi-matrix eigenvalues corresponding to each of the gates.
• TPpenalty : a prefactor multiplying the sum of absoulte-value differences between the first row of each gate matrix and [1 0 ... 0 ] and the discrpance between the first element of each state preparation vector and its expected value.
• validSpamPenalty : a prefactor multiplying penalty terms enforcing the non-negativity of state preparation eigenavlues and that POVM effect eigenvalues lie between 0 and 1.
• gatesMetric : how to compare corresponding gates in the gauge-optimized and target sets. "frobenius" uses the frobenius norm (weighted before taking the final sqrt), "fidelity" uses the squared process infidelity (squared to avoid negative-infidelity issues in non-TP gate sets), and "tracedist" uses the trace distance (weighted after computing the trace distance between corresponding gates).
• spamMetric : how to compare corresponding SPAM vectors. "frobenius" (the default) should be used here, as "fidelity" and "tracedist" compare the "SPAM gates" -- the outer product of state prep and POVM effect vectors -- which isn't a meaningful metric.

The cell below demonstrates some of common usages of gaugeopt_to_target.

In :
gs = gs_mle.copy() #we'll use the MLGST result from above as an example
gs_go1 = pygsti.gaugeopt_to_target(gs, gs_target) # optimization to the perfect target gates
gs_go2 = pygsti.gaugeopt_to_target(gs, depol_gateset) # optimization to a "guess" at what the estimate should be
gs_go3 = pygsti.gaugeopt_to_target(gs, gs_target, {'gates': 1.0, 'spam': 0.01})
# weight the gates differently from the SPAM operations
gs_go4 = pygsti.gaugeopt_to_target(gs, gs_target, {'gates': 1.0, 'spam': 0.01, 'Gx': 10.0, 'E0': 0.001})
# weight an individual gate/SPAM separately (note the specific gate/SPAM labels always override
# the more general 'gates' and 'spam' weight values).
gs_go5 = pygsti.gaugeopt_to_target(gs, gs_target, gatesMetric="tracedist") #use trace distance instead of frobenius

print("Default gauge group = ",type(gs.default_gauge_group)) # default is FullGaugeGroup
gs_go6 = pygsti.gaugeopt_to_target(gs, gs_target, gauge_group=pygsti.objects.UnitaryGaugeGroup(gs.dim, 'pp'))
#gauge optimize only over unitary gauge transformations

print("\ngaugeopt_to_target output:")
gs_go7 = pygsti.gaugeopt_to_target(gs, gs_target, verbosity=3) # show output
print("Final frobenius distance between gs_go7 and gs_target = ", gs_go7.frobeniusdist(gs_target))

Default gauge group =  <class 'pygsti.objects.gaugegroup.FullGaugeGroup'>

gaugeopt_to_target output:
--- Gauge Optimization (ls method) ---
--- Outer Iter 0: norm_f = 0.091421, mu=0, |J|=7.24835
--- Outer Iter 1: norm_f = 0.0914134, mu=0.00171217, |J|=7.2468
--- Outer Iter 2: norm_f = 0.0914134, mu=0.000570723, |J|=7.24671
Least squares message = Both actual and predicted relative reductions in the sum of squares are at most 1e-08
Gauge optimization completed in 0.0260451s.
Final frobenius distance between gs_go7 and gs_target =  0.03903275393537098


## Compare MLGST with MC2GST (after gauge optimization)¶

Both MLGST and MC2GST use a $\chi^{2}$ optimization procedure for all but the final iteration. For the last set of gatestrings (the last iteration), MLGST uses a maximum likelihood estimation. Below, we show how close the two estimates are to one another. Before making the comparison, however, we optimize the gauge so the estimated gates are as close to the target gates as the gauge degrees of freedom allow.

In :
# We optimize over the gate set gauge
gs_mle         = pygsti.gaugeopt_to_target(gs_mle,depol_gateset)
gs_mle_lowcnts = pygsti.gaugeopt_to_target(gs_mle_lowcnts,depol_gateset)
gs_mc2         = pygsti.gaugeopt_to_target(gs_mc2,depol_gateset)
gs_mc2_lowcnts = pygsti.gaugeopt_to_target(gs_mc2_lowcnts,depol_gateset)

In :
print("Frobenius diff btwn MLGST  and datagen = {0}".format(round(gs_mle.frobeniusdist(depol_gateset), 6)))
print("Frobenius diff btwn MC2GST and datagen = {0}".format(round(gs_mc2.frobeniusdist(depol_gateset), 6)))
print("Frobenius diff btwn MLGST  and LGST    = {0}".format(round(gs_mle.frobeniusdist(gs_clgst), 6)))
print("Frobenius diff btwn MLGST  and MC2GST  = {0}".format(round(gs_mle.frobeniusdist(gs_mc2), 6)))
print("Chi^2 ( MC2GST ) = {0}".format(round(pygsti.chi2(gs_mc2, ds, lsgstListOfLists[-1]), 4)))
print("Chi^2 ( MLGST )  = {0}".format(round(pygsti.chi2(gs_mle, ds, lsgstListOfLists[-1] ), 4)))
print("LogL  ( MC2GST ) = {0}".format(round(pygsti.logl(gs_mc2, ds, lsgstListOfLists[-1]), 4)))
print("LogL  ( MLGST )  = {0}".format(round(pygsti.logl(gs_mle, ds, lsgstListOfLists[-1]), 4)))

Frobenius diff btwn MLGST  and datagen = 0.001986
Frobenius diff btwn MC2GST and datagen = 0.001987
Frobenius diff btwn MLGST  and LGST    = 0.012193
Frobenius diff btwn MLGST  and MC2GST  = 5.3e-05
Chi^2 ( MC2GST ) = 1251.6313
Chi^2 ( MLGST )  = 1251.9954
LogL  ( MC2GST ) = -2136570.5208
LogL  ( MLGST )  = -2136570.337


Notice that, as expected, the MC2GST estimate has a slightly lower $\chi^{2}$ score than the MLGST estimate, and the MLGST estimate has a slightly higher loglikelihood than the MC2GST estimate. In addition, both are close (in terms of the Frobenius difference) to the depolarized gateset. Which is good - it means GST is giving us estimates which are close to the true gateset used to generate the data. Performing the same analysis with the low-count data shows larger differences between the two, which is expected since the $\chi^2$ and loglikelihood statistics are more similar at large $N$, that is, for large numbers of samples.

In :
print("LOW COUNT DATA:")
print("Frobenius diff btwn MLGST  and datagen = {0}".format(round(gs_mle_lowcnts.frobeniusdist(depol_gateset), 6)))
print("Frobenius diff btwn MC2GST and datagen = {0}".format(round(gs_mc2_lowcnts.frobeniusdist(depol_gateset), 6)))
print("Frobenius diff btwn MLGST  and LGST    = {0}".format(round(gs_mle_lowcnts.frobeniusdist(gs_clgst), 6)))
print("Frobenius diff btwn MLGST  and MC2GST  = {0}".format(round(gs_mle_lowcnts.frobeniusdist(gs_mc2), 6)))
print("Chi^2 ( MC2GST )  = {0}".format(round(pygsti.chi2(gs_mc2_lowcnts, dsLowCounts, lsgstListOfLists[-1]), 4)))
print("Chi^2 ( MLGST )   = {0}".format(round(pygsti.chi2(gs_mle_lowcnts, dsLowCounts, lsgstListOfLists[-1] ), 4)))
print("LogL  ( MC2GST )  = {0}".format(round(pygsti.logl(gs_mc2_lowcnts, dsLowCounts, lsgstListOfLists[-1]), 4)))
print("LogL  ( MLGST )   = {0}".format(round(pygsti.logl(gs_mle_lowcnts, dsLowCounts, lsgstListOfLists[-1]), 4)))

LOW COUNT DATA:
Frobenius diff btwn MLGST  and datagen = 0.008493
Frobenius diff btwn MC2GST and datagen = 0.008537
Frobenius diff btwn MLGST  and LGST    = 0.015241
Frobenius diff btwn MLGST  and MC2GST  = 0.009214
Chi^2 ( MC2GST )  = 1267.9804
Chi^2 ( MLGST )   = 1275.6837
LogL  ( MC2GST )  = -106889.6808
LogL  ( MLGST )   = -106885.8592

In [ ]: