fix: check if repository is available in provenance available check

If a repository is not available for an artifact/analysis target identified by a PURL string, the  mcn_provenance_available_1 check throws an exception.
This PR fixes this bug by checking if the repository is available before running the check.

As we have discussed, I wonder if this issue can be prevented with static type checking. We should revisit this in the future to see if there is a solution that works well with both SQLAlchemy and mypy.

Yes, it would be nice to enforce type checking on repositories, which can be None in our data model. But that requires some investigation.


Recurring Events Monthly Event Issue

Hi
just installed Events 6.2.2 version and now I  have an issue with Recurring events option. First when I create an event I have to save before I can select Recurring events and Monthly Events checkbox is not responding at all. other options are available. DNN version 07.04.02
thanks

If you are not using the default standard DNN skin, try that one first.


TODO/FIXME highlighting support broken

TODO/FIXME highlighting does not render with the React language enabled

Will be fixed in a upcoming release.


No Peak Power Data

Thank you for your selfless open-source contribution; it's truly an amazing project. I noticed that peak power and other power data cannot be displayed during my use. Do I need to subscribe to Strava Premium to view this data?

It looks like the estimated power data is not present on the activity.  I wasn't aware of Strava making that feature tied to their premium tier though.  Can you email me the activity in question so I can look at it<EMAIL_ADDRESS>


Time is always in UTC

Even if I set the option to false or modified the source code and changed the default configuration to false. Graph still shows UTC format.

Could you give an example on http://jsfiddle.net or similar site?

I'm using it for WebViews in mobile using Appcelerator Titanium for android and iOS. Do you think it's because of that? What I did was download the zip file, and copied ONLY the Chart.Scatter.js. I already have the Chart.js core.

I think it's probably a bug. I will try to reproduce and fix it today. If it is possible, make me an example on http://jsfiddle.net or send me your data and chart options.

I'm checked how to works useUtc parameter and changed some incorrect behaviour.
If useUtc parameter is true then date values is interpreted as UTC dates. Else they is interpreted as local dates. It affects to point and scale labels and to scale limits.
Please update your Chart.Scatter.js from GitHub and check, how it works.

Thanks! The fix is working. I have another issue though. I have this data,
data = [{
	x :<PHONE_NUMBER>,
	y : 65.07
}, {
	x :<PHONE_NUMBER>,
	y : 62.21
}, {
	x :<PHONE_NUMBER>,
	y : 61.07
}]

The data above is the only the green part. It's supposed to show a daily data. But instead of seeing the date as x-axis, you only see the time and you won't have any idea what date it is.

Thanks! The fix is working. I have another issue though. I have this data,
data = [{
	x :<PHONE_NUMBER>,
	y : 65.07
}, {
	x :<PHONE_NUMBER>,
	y : 62.21
}, {
	x :<PHONE_NUMBER>,
	y : 61.07
}]

The data above is the only the green part. It's supposed to show a daily data. But instead of seeing the date as x-axis, you only see the time and you won't have any idea what date it is.
I know that I can use the normal line chart here, but what if there is a day that have no data, so I would still need to use scatter chart here. Thanks for helping.

I'm sorry for the delay of my reply . I will try to reproduce your case and will write you.

It was my error again. It's fixed.
http://jsfiddle.net/avdubdw2/1/
Thank you for your help!

Sorry for the very late reply. I just tried it, and it's working! Thanks for your help! :)


add calculateCommunityTrancheAmount to allow managers to see how much they will receive when requesting

https://github.com/impactMarket/impact-market-smart-contracts/pull/115/files#diff-4d606813be4895a519ec98c13091dac13326d59f1675277a2a7472737fae5fa0R661

requests are now done alongside claims


Line arrows example

Add an example than shows how to draw arrows to a linestring (end of each segment)

Thanks for any review

Note: an icon is used for the arrow but it should be possible to use a ol.style.RegularShape when an anchor options will be available (see #3342)

@elemoine @tsauerwein: any other comments?

No more objections from my side.

Looking again…

It looks good to me.
I just note that the style function will generate a lot of garbage if there is a lot of lines and segments. I know that this is not a problem in that particular example, but it would be good to always show good practices to users.
Instead of function(ol.Feature, number):Array.<ol.style.Style> the style function signature could possibly be function(ol.Feature, number, function(ol.style.Style)). And the style function would call the function passed as a third argument for each style it wants to generate.
So with this your example's style function could look like this:
var lineStyle = new ol.style.Style({
  stroke: new ol.style.Stroke({
    // …
  })
});

var arrowStyle = new ol.style.Style({
  image: new ol.style.Icon({
    // …
  })
});

function styleFunction(feature, resolution, callback) {
  callback(lineStyle);
  feature.getGeometry().forEachSegment(function(start, end) {
    var dx = end[0] - start[0];
    var dy = end[1] - start[1];
    var rotation = Math.atan2(dy, dx);
    arrowStyle.setGeometry(new ol.geom.Point(end));
    arrowStyle.getImageStyle().setRotation(-rotation);
    callback(arrowStyle);
  });
}

Note something to do in this PR, but as a separate PR possibly.

Thanks for the review


Use of @nuxtjs/prismic with nuxt-i18n

In the newer version of nuxt-18n, the url of the pages can be internationalized in the nuxt.config.js
  modules: [
    [
      'nuxt-i18n',
      {
        parsePages: false, // Required
        pages: {
          about: {
            'fr-fr': '/a-propos',
            'en-gb': '/about'
          }
        }
      }
    ],

If I miss parsePage: false it is yelling because it can't find preview.vue generated by @nuxtjs/prismic.

ERROR  ENOENT: no such file or directory, open '/Users/ace/Projects/PIX/pix-site/.nuxt/prismic/pages/preview.vue'

But I need parsePage: true, because the pages name can also be specified in the page file
export default {
  name: 'About',
  nuxtI18n: {
    paths: {
          'fr-fr': '/a-propos',
          'en-gb': '/about'
    }
  },

Any advice on how to achieve that?

Hey @aceol, sorry for the late answer, have you tried excluding preview from i18n: https://i18n.nuxtjs.org/routing.html#ignore-routes (last example), perhaps something like this could solve your issue, let me know!
modules: [
  [
    'nuxt-i18n',
    {
      parsePages: false, // Required
      pages: {
        about: {
          'fr-fr': '/a-propos',
          'en-gb': '/about'
        }
      }
    }
  ],
  /* ... */
}

@lihbr I just encountered this issue as well when using @nuxtjs/i18n.
Adding pages.preview: false fixes the issue, but only if parsePages is false.

Very nice catch! Didn't know about this option. Published in 1.4.2


JS: improve alert message for js/useless-assignment-to-local

Fixes #3165.
For the below example we would previously report: The initial value of nSign is unused, since it is always overwritten..
However, the definition of nSign is never actually overwritten, and thus the error message is confusing.
(function() {
   if (something()) {
      var nSign = foo(); // the value assigned here is never read
   } else {
      console.log(nSign); // nSign is always undefined here.
   }
})()

With this PR a dominating definition must exist for the error message to mention "overwritten".
The error message defaults to This definition of nSign is useless, since its value is never read., which will now be reported for the above example.

@asgerf can I get another thumbs up?


Check syntax highlighting for C# XML doc comments

There's a case here:
http://referencesource.microsoft.com/#System.Drawing/commonui/System/Drawing/ImageAnimator.cs,66
where I can't explain the black spans in the sea of green.  We should try indexing test code with that comment and see if we can repro it.
See also https://github.com/KirillOsenkov/SourceBrowser/issues/79

Not an issue in Codex.


Unable to call component method. Public method [data] not found on component

Description
Getting the above error using the latest versions of Livewire and AlpineJS. The error disappears when I remove <livewire:toasts /> from my app.blade.php file.
To Reproduce

Install latest AlpineJS and Livewire
Install latest tall-toasts
add <livewire:toasts /> to top of <body> tag

Expected behavior
It should not fail.

Never mind, it turns out I was loading the plugin in the wrong way, using the old syntax Alpine.data('ToastComponent', ToastComponent) - it works when loading it the proper way. My bad.


Cannot retrieve scan data due to forced abort()

@tacaswell @danielballan A user initiated a scan to collect 7200.  They then decided to  stop the scan.  When the command prompt returned, they typed stop() but the camera was still writing data.  They decided to abort().  Now they cannot access the data.  The user is here until Tuesday morning.  Can someone please look into this today - for them to get the data, and then why this happened at your convenience.  I will try to trace back through the terminal in a bit.
Scan info:
6/19/16, 11:03 am
generator ['86afec'] (scan num: 65634)

I'll stop by today to look at this.

A user initiated a scan to collect 7200.

What kind of scan? Does 7200 refer to fccd.num_images?

I will try to trace back through the terminal in a bit.

If you can do that, I think it would help.

'86afec'

There seems to be no RunStart document in your metadatastore with this uid.  (Did you get an olog entry?)

Yes, fccd.num_images.  The ^C during the scan when they reach 5000 images collected.  The record is in olog Aquistion.  That is why I know the unique id string.  I see I forgot to copy the SCAN ID # (65634)
Tried '86afec', and same errors.  See below from jhub notebook
bgnd8 = DataBroker[65505] #[59111]
bgnd2 = None #DataBroker[59112] #DataBroker['165e034b-83de-4769-b80f-447194e701c5'] #None #DataBroker[59112]
bgnd1 = None # DataBroker[''] #[]
data = DataBroker['86afec'] #[59110]

tbl=get_table(data,fill='False')

tbl  #prints a table with all the readable detectors (motor positions at time of measurement)

OUTPUT is a square
stack = get_fastccd_images(data, (bgnd8, bgnd2, bgnd1), tag='fccd_image')  #fccd_image_lightfield
images = stack[0]

OUTPUT
---------------------------------------------------------------------------
ValueError                                Traceback (most recent call last)
<ipython-input-6-e2261f830d28> in <module>()
----> 1 stack = get_fastccd_images(data, (bgnd8, bgnd2, bgnd1), tag='fccd_image')  #fccd_image_lightfield
      2 images = stack[0]

/opt/conda_envs/analysis/lib/python3.4/site-packages/csxtools/utils.py in get_fastccd_images(light_header, dark_headers, flat, gain, tag, roi, handler_override)
    127
    128     events = _get_images(light_header, tag, roi,
--> 129                          handler_override=handler_override)
    130
    131     # Ok, so lets return a pims pipeline which does the image conversion

/opt/conda_envs/analysis/lib/python3.4/site-packages/csxtools/utils.py in _get_images(header, tag, roi, handler_override)
    187 def _get_images(header, tag, roi=None, handler_override=None):
    188     t = ttime.time()
--> 189     images = get_images(header, tag, handler_override=handler_override)
    190     t = ttime.time() - t
    191     logger.info("Took %.3f seconds to read data using get_images", t)

/opt/conda_envs/analysis/lib/python3.4/site-packages/databroker/pims_readers.py in get_images(headers, name, handler_registry, handler_override)
     29             # do something
     30     """
---> 31     return Images(headers, name, handler_registry, handler_override)
     32
     33

/opt/conda_envs/analysis/lib/python3.4/site-packages/databroker/pims_readers.py in __init__(self, headers, name, handler_registry, handler_override)
     56         """
     57         events = get_events(headers, [name], fill=False)
---> 58         self._datum_uids = [event.data[name] for event in events
     59                             if name in event.data]
     60         self._len = len(self._datum_uids)

/opt/conda_envs/analysis/lib/python3.4/site-packages/databroker/pims_readers.py in <listcomp>(.0)
     56         """
     57         events = get_events(headers, [name], fill=False)
---> 58         self._datum_uids = [event.data[name] for event in events
     59                             if name in event.data]
     60         self._len = len(self._datum_uids)

/opt/conda_envs/analysis/lib/python3.4/site-packages/databroker/databroker.py in get_events(headers, fields, fill, handler_registry, handler_overrides)
    364         fields = []
    365     fields = set(fields)
--> 366     _check_fields_exist(fields, headers)
    367
    368     for header in headers:

/opt/conda_envs/analysis/lib/python3.4/site-packages/databroker/databroker.py in _check_fields_exist(fields, headers)
    641     missing = fields - all_fields
    642     if missing:
--> 643         raise ValueError("The fields %r were not found." % missing)

ValueError: The fields {'fccd_image'} were not found.

here is the transcript from the bluesky terminal.  Their definition calls RE(ct()).  The stopped it when 5000 images were taken.  They were worried that they would have trouble with 7200 images because they were running out of memory and were not sure that we could solve the problem for them.  That was fixed, but users will often need to stop a scan like this.
 The RunEngine will pause at the next checkpoint. To pause immediately, hit Ctrl+C again in the next 10 seconds.
Deferred pause acknowledged. Continuing to checkpoint.
stop()
^C^C
Your RunEngine is entering a paused state. These are your options for changing
the state of the RunEngine:

resume()  --> will resume the scan
 abort()  --> will kill the scan with an 'aborted' state to indicate
              the scan was interrupted
  stop()  --> will kill the scan with a 'finished' state to indicate
              the scan stopped normally

Pro Tip: Next time, if you want to abort, tap Ctrl+C three times quickly.

Pausing...
OK

In [73]: stop()
Stopping...
^CA 'deferred pause' has been requested. The RunEngine will pause at the next checkpoint. To pause immediately, hit Ctrl+C again in the next 10 seconds.
Deferred pause acknowledged. Continuing to checkpoint.
^C
Your RunEngine is entering a paused state. These are your options for changing
the state of the RunEngine:

resume()  --> will resume the scan
 abort()  --> will kill the scan with an 'aborted' state to indicate
              the scan was interrupted
  stop()  --> will kill the scan with a 'finished' state to indicate
              the scan stopped normally

Pro Tip: Next time, if you want to abort, tap Ctrl+C three times quickly.

Pausing...

In [74]: abort()
Aborting....
generator ct ['86afec'] (scan num: 65634)

In [75]: olog('Measurement scan 34 aborted, temperature changed to 300K')

In [76]: fccd_set(1,60)
Current fCCD config: 60.0 images @ 1.00 Hz = 60.0 s

In [77]: ct_all_dark()

Starting procedure to acquire camera gains at 1.0Hz

Camera stopped..

Gain bit set to 2

Camera restarted..
Transient Scan ID: 65635
Persistent Unique Scan ID: '1c775526-f717-448a-9e86-d54070316cbf'
/home/xf23id1/conda_envs/collection/lib/python3.4/site-packages/bluesky/run_engine.py:1821: UserWarning: A ReadTimeout(ReadTimeoutError("HTTPSConnectionPool(host='xf23id1-log.cs.nsls2.local', port=8181): Read timed out. (read timeout=30)",),) was raised during the processing of a start Document. The error will be ignored to avoid interrupting data collection. To investigate, set RunEngine.ignore_callback_exceptions = False and run again.
  "and run again." % (exc, name.name))
+-----------+------------+-------------------+-------------------+-------------------+------------+------------+------------+------------+------------+
|   seq_num |       time | fccd_stats1_total | fccd_stats2_total | fccd_stats3_total | mono_tempa | mono_tempb |  grt1_temp |  grt2_temp |    uw_temp |
+-----------+------------+-------------------+-------------------+-------------------+------------+------------+------------+------------+------------+
|         1 | 13:37:22.3 |<PHONE_NUMBER> |<PHONE_NUMBER>9 |<PHONE_NUMBER>5 |    302.749 |    302.749 |       31.6 |       28.8 |      85.12 |
+-----------+------------+-------------------+-------------------+-------------------+------------+------------+------------+------------+------------+
generator ct ['1c7755'] (scan num: 65635)

OK, I understand what happened.
First of all, ignore my earlier comment, "There seems to be no RunStart document in your metadatastore with this uid." That was an unrelated problem I was having.
What Ocurred

The run was started. A RunStart document was emitted. It was saved in metadatastore, and we can load it from the databroker. It also triggered the creation of an olog entry. So far, so good.
The detector was staged. This sets a fresh HDF5 filename in the area detector and prepares it for writing.
The detector was triggered. A multi-acquisition was begun.
Normally, once the detector is done acquiring, an Event document is emitted and saved in metadatastore. The plan was aborted before this happened.

How this explains what you see now
This explains why tbl is an empty DataFrame. (This displays as an empty square; using print we can see a little more clearly what it is....)
In [5]: print(tbl)
Empty DataFrame
Columns: []
Index: []

The raw get_events function confirms that there is no data from this run in metadatastore --- just the RunStart document.
In [6]: len(list(get_events(h_data)))
Out[6]: 0

What next?
The data is likely salvageable. HDF5 file exists, but no record of it was created in metadatastore. I can help you retrieve it tomorrow morning before my group meeting at 10.
To avoid this problem in the future, we should eliminate the long delay between when the detector starts saving data into a file and when we emit the Event document that provides a reference to that data. This was on our radar, but this is the first time I've heard of this particular failure mode.

Sounds great.  I reproduced it just now.  They have to quit stop() because that seems ineffective.  Thus abort() is the only option.  If it happens again, we will try selecting the done capture button while stuck in the loop that handles stop().
Transient Scan ID: 65692
Persistent Unique Scan ID: '94a4d26e-cf2c-45c7-98d9-9b4f7cfecbac'
+-----------+------------+-------------------+-------------------+-------------------+------------+------------+------------+------------+------------+
|   seq_num |       time | fccd_stats1_total | fccd_stats2_total | fccd_stats3_total | mono_tempa | mono_tempb |  grt1_temp |  grt2_temp |    uw_temp |
+-----------+------------+-------------------+-------------------+-------------------+------------+------------+------------+------------+------------+
|         1 | 15:23:54.3 |           -140604 |          -1790229 |          -1561333 |    302.756 |    302.755 |       29.2 |       28.8 |      85.38 |
+-----------+------------+-------------------+-------------------+-------------------+------------+------------+------------+------------+------------+
generator ct ['94a4d2'] (scan num: 65692)

Returned to initial gain setting and restarting acquisition
Current fCCD config: 7200.0 images @ 1.00 Hz = 7200.0 s
^C---------------------------------------------------------------------------
KeyboardInterrupt                         Traceback (most recent call last)
/home/xf23id1/Users/2016_06_Porro/2016_06_20_overnight.py in <module>()
----> 1 multi_T(1,7200)

/home/xf23id1/Users/2016_06_Porro/2016_06_20_overnight.py in multi_T(freq, tot_time_1)
     90         #mov(temp_sp,tt)
     91         caput('XF:23ID1-ES{TCtrl:1-Out:1}T-SP',tt)
---> 92         sleep(3600)
     93         RE(ct())
     94         olog('Measurement, #{} @ {:.1f} eV, {:.2f} Hz at {:.1f} K for {} images over {:.1f} s'.format((db[-1].get('start').get('scan_id')), pgm_en.get()[1], 1./fccd.acquire_time.get(), temp.a.value,fccd.plugin_num_images.get(),fccd.plugin_num_images.get()*fccd.acquire_time.get()))

KeyboardInterrupt:

In [184]:
KeyboardInterrupt

In [184]:
KeyboardInterrupt

In [184]: stop()
---------------------------------------------------------------------------
TransitionError                           Traceback (most recent call last)
/home/xf23id1/Users/2016_06_Porro/2016_06_20_overnight.py in <module>()
----> 1 stop()

/home/xf23id1/conda_envs/collection/lib/python3.4/site-packages/bluesky/global_state.py in stop()
    166     This function closes over the global RunEngine instance, gs.RE.
    167     """
--> 168     return gs.RE.stop()
    169
    170

/home/xf23id1/conda_envs/collection/lib/python3.4/site-packages/bluesky/run_engine.py in stop(self)
    756         """
    757         if self.state.is_idle:
--> 758             raise TransitionError("RunEngine is already idle.")
    759         print("Stopping...")
    760         self._interrupted = True

TransitionError: RunEngine is already idle.

In [185]: grabit
Select area of screen to grab .........

In [186]: fccd_set(1,7200)
Current fCCD config: 7200.0 images @ 1.00 Hz = 7200.0 s

In [187]: %run -i ~/Users/2016_06_Porro/startup.py

In [188]: RE(ct())
Transient Scan ID: 65693
Persistent Unique Scan ID: '44407fa8-9acf-4b8a-bd27-568161906628'
^CA 'deferred pause' has been requested. The RunEngine will pause at the next checkpoint. To pause immediately, hit Ctrl+C again in the next 10 seconds.
Deferred pause acknowledged. Continuing to checkpoint.
^C
Your RunEngine is entering a paused state. These are your options for changing
the state of the RunEngine:

resume()  --> will resume the scan
 abort()  --> will kill the scan with an 'aborted' state to indicate
              the scan was interrupted
  stop()  --> will kill the scan with a 'finished' state to indicate
              the scan stopped normally

Pro Tip: Next time, if you want to abort, tap Ctrl+C three times quickly.

Pausing...
Out[188]: ['44407fa8-9acf-4b8a-bd27-568161906628']

In [189]:

In [189]: stop()
Stopping...

1 minute later
^CA 'deferred pause' has been requested. The RunEngine will pause at the next checkpoint. To pause immediately, hit Ctrl+C again in the next 10 seconds.
Deferred pause acknowledged. Continuing to checkpoint.
^C
Your RunEngine is entering a paused state. These are your options for changing
the state of the RunEngine:

resume()  --> will resume the scan
 abort()  --> will kill the scan with an 'aborted' state to indicate
              the scan was interrupted
  stop()  --> will kill the scan with a 'finished' state to indicate
              the scan stopped normally

Pro Tip: Next time, if you want to abort, tap Ctrl+C three times quickly.

Pausing...

In [190]: stop()
Stopping...

1 minute later

abort()
^CA 'deferred pause' has been requested. The RunEngine will pause at the next checkpoint. To pause immediately, hit Ctrl+C again in the next 10 seconds.
Deferred pause acknowledged. Continuing to checkpoint.
^C
Your RunEngine is entering a paused state. These are your options for changing
the state of the RunEngine:

resume()  --> will resume the scan
 abort()  --> will kill the scan with an 'aborted' state to indicate
              the scan was interrupted
  stop()  --> will kill the scan with a 'finished' state to indicate
              the scan stopped normally

Pro Tip: Next time, if you want to abort, tap Ctrl+C three times quickly.

Pausing...

In [191]:
KeyboardInterrupt

In [191]: abort()
Aborting....
generator ct ['44407f'] (scan num: 65693)

In [192]:

We are working on the underlying issue with stop() as well. Should straighten all this out by the end of the week. Thanks as always for your patience.
Get Outlook for iOShttps://aka.ms/o0ukef
On Mon, Jun 20, 2016 at 5:32 PM -0400, "ambarb" <notifications<EMAIL_ADDRESS>wrote:
Sounds great. I reproduced it just now. They have to quit stop() because that seems ineffective. Thus abort() is the only option. If it happens again, we will try selecting the done capture button while stuck in the loop that handles stop().
Transient Scan ID: 65692
Persistent Unique Scan ID: '94a4d26e-cf2c-45c7-98d9-9b4f7cfecbac'
+-----------+------------+-------------------+-------------------+-------------------+------------+------------+------------+------------+------------+
|   seq_num |       time | fccd_stats1_total | fccd_stats2_total | fccd_stats3_total | mono_tempa | mono_tempb |  grt1_temp |  grt2_temp |    uw_temp |
+-----------+------------+-------------------+-------------------+-------------------+------------+------------+------------+------------+------------+
|         1 | 15:23:54.3 |           -140604 |          -1790229 |          -1561333 |    302.756 |    302.755 |       29.2 |       28.8 |      85.38 |
+-----------+------------+-------------------+-------------------+-------------------+------------+------------+------------+------------+------------+
generator ct ['94a4d2'] (scan num: 65692)
Returned to initial gain setting and restarting acquisition
Current fCCD config: 7200.0 images @ 1.00 Hz = 7200.0 s
^C---------------------------------------------------------------------------
KeyboardInterrupt                         Traceback (most recent call last)
/home/xf23id1/Users/2016_06_Porro/2016_06_20_overnight.py in ()
----> 1 multi_T(1,7200)
/home/xf23id1/Users/2016_06_Porro/2016_06_20_overnight.py in multi_T(freq, tot_time_1)
90         #mov(temp_sp,tt)
91         caput('XF:23ID1-ES{TCtrl:1-Out:1}T-SP',tt)
---> 92         sleep(3600)
93         RE(ct())
94         olog('Measurement, #{} @ {:.1f} eV, {:.2f} Hz at {:.1f} K for {} images over {:.1f} s'.format((db[-1].get('start').get('scan_id')), pgm_en.get()[1], 1./fccd.acquire_time.get(), temp.a.value,fccd.plugin_num_images.get(),fccd.plugin_num_images.get()*fccd.acquire_time.get()))
KeyboardInterrupt:
In [184]:
KeyboardInterrupt
In [184]:
KeyboardInterrupt
In [184]: stop()
TransitionError                           Traceback (most recent call last)
/home/xf23id1/Users/2016_06_Porro/2016_06_20_overnight.py in ()
----> 1 stop()
/home/xf23id1/conda_envs/collection/lib/python3.4/site-packages/bluesky/global_state.py in stop()
166     This function closes over the global RunEngine instance, gs.RE.
167     """
--> 168     return gs.RE.stop()
169
170
/home/xf23id1/conda_envs/collection/lib/python3.4/site-packages/bluesky/run_engine.py in stop(self)
756         """
757         if self.state.is_idle:
--> 758             raise TransitionError("RunEngine is already idle.")
759         print("Stopping...")
760         self._interrupted = True
TransitionError: RunEngine is already idle.
In [185]: grabit
Select area of screen to grab .........
In [186]: fccd_set(1,7200)
Current fCCD config: 7200.0 images @ 1.00 Hz = 7200.0 s
In [187]: %run -i ~/Users/2016_06_Porro/startup.py
In [188]: RE(ct())
Transient Scan ID: 65693
Persistent Unique Scan ID: '44407fa8-9acf-4b8a-bd27-568161906628'
^CA 'deferred pause' has been requested. The RunEngine will pause at the next checkpoint. To pause immediately, hit Ctrl+C again in the next 10 seconds.
Deferred pause acknowledged. Continuing to checkpoint.
^C
Your RunEngine is entering a paused state. These are your options for changing
the state of the RunEngine:
resume()  --> will resume the scan
abort()  --> will kill the scan with an 'aborted' state to indicate
the scan was interrupted
stop()  --> will kill the scan with a 'finished' state to indicate
the scan stopped normally
Pro Tip: Next time, if you want to abort, tap Ctrl+C three times quickly.
Pausing...
Out[188]: ['44407fa8-9acf-4b8a-bd27-568161906628']
In [189]:
In [189]: stop()
Stopping...
1 minute later
^CA 'deferred pause' has been requested. The RunEngine will pause at the next checkpoint. To pause immediately, hit Ctrl+C again in the next 10 seconds.
Deferred pause acknowledged. Continuing to checkpoint.
^C
Your RunEngine is entering a paused state. These are your options for changing
the state of the RunEngine:
resume()  --> will resume the scan
abort()  --> will kill the scan with an 'aborted' state to indicate
the scan was interrupted
stop()  --> will kill the scan with a 'finished' state to indicate
the scan stopped normally
Pro Tip: Next time, if you want to abort, tap Ctrl+C three times quickly.
Pausing...
In [190]: stop()
Stopping...
1 minute later
abort()
^CA 'deferred pause' has been requested. The RunEngine will pause at the next checkpoint. To pause immediately, hit Ctrl+C again in the next 10 seconds.
Deferred pause acknowledged. Continuing to checkpoint.
^C
Your RunEngine is entering a paused state. These are your options for changing
the state of the RunEngine:
resume()  --> will resume the scan
abort()  --> will kill the scan with an 'aborted' state to indicate
the scan was interrupted
stop()  --> will kill the scan with a 'finished' state to indicate
the scan stopped normally
Pro Tip: Next time, if you want to abort, tap Ctrl+C three times quickly.
Pausing...
In [191]:
KeyboardInterrupt
In [191]: abort()
Aborting....
generator ct ['44407f'] (scan num: 65693)
In [192]:
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHubhttps://github.com/NSLS-II/Bug-Reports/issues/121#issuecomment-227276046, or mute the threadhttps://github.com/notifications/unsubscribe/ACLIrow8HGOfLTOV2q2KzJ9CvSbsKHHsks5qNwbOgaJpZM4I5yJG.

This has been addressed by

@danielballan creating the missing events 'by hand'
@danielballan giving them a proto-type of a custom trigger_and_read which reads before it waits.


[FLINK-32551] Add option to take a savepoint when deleting a flinkdeployment/flinksessionjob

What is the purpose of the change
Add an operator option to make savepoint on FlinkDeployment/FlinkSessionJob deletion. Default behaviour is not changed and no savepoint are being made.
Brief change log

Adds a new operator configuration
Inject the Operator config to all reconcilers upon creation
Factorise cleanUp job interface to unify Upgrade mode determination upon cleanup
Added unit test to the new cleanup behaviour

Verifying this change

Additional unit tests
Manual tests on K8s

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): no
The public API, i.e., is any changes to the CustomResourceDescriptors: yes, Adds a new operator configuration
Core observer or reconciler logic that is regularly executed: yes

Documentation

Does this pull request introduce a new feature? yes
If yes, how is the feature documented? docs are generated from the config

Are you working with @ashangit ? Just curious because he also has an open PR and the JIRA is on him

Are you working with @ashangit ? Just curious because he also has an open PR and the JIRA is on him

yes, he is OOO currently, I am continuing his development. Would value feedback

Can you please rebase to the latest main? The changes look good I will merge after :)

rebased and squashed everything into the single commit


Release v1.0.0

#Fixes: #71
Request to merge develop into main for v1.0.0 stable release.

Force pushing to trigger the tests again. The branch tests weren't triggering.


Validate primaryIdentifier is unique against all resources in a template

Is this feature request related to a new rule or cfn-lint capabilities?
rules
Describe the feature you'd like to request
As we convert to the schema there is new properties.  We can look at primaryIdentifier (minus readOnlyProperties) and validate those primaryIdentifiers are unique against all resources in a template.
Example of this would be RoleName in AWS::IAM::Role
Describe the solution you'd like
A new rule that validates the uniqueness of primaryIdentifiers across all resources of a type
Additional context
root already exists in stack arn:aws:cloudformation:us-east-1:0123456789012:stack/stack-name/unique-id
for template
Resources:
  RootRole:
    Type: 'AWS::IAM::Role'
    Properties:
      AssumeRolePolicyDocument:
        Version: "2012-10-17"
        Statement:
          - Effect: Allow
            Principal:
              Service:
                - ec2.amazonaws.com
            Action:
              - 'sts:AssumeRole'
      Path: /
      RoleName: root
      Policies:
        - PolicyName: root
          PolicyDocument:
            Version: "2012-10-17"
            Statement:
              - Effect: Allow
                Action: '*'
                Resource: '*'
  RootRole2:
    Type: 'AWS::IAM::Role'
    Properties:
      AssumeRolePolicyDocument:
        Version: "2012-10-17"
        Statement:
          - Effect: Allow
            Principal:
              Service:
                - ec2.amazonaws.com
            Action:
              - 'sts:AssumeRole'
      Path: /
      RoleName: root
      Policies:
        - PolicyName: root
          PolicyDocument:
            Version: "2012-10-17"
            Statement:
              - Effect: Allow
                Action: '*'
                Resource: '*'

Is this something that you'd be interested in working on?

[X] 👋 I may be able to implement this feature request

Would this feature include a breaking change?

[X] ⚠ This feature might incur a breaking change

Duplicate of https://github.com/aws-cloudformation/cfn-lint/issues/1326

Whoops closing for the other ticket.


Unable to create folders

Issues:

Code should be removed from properties
Should we allow only IM scheme for folders?
Do we need Activate/Deactivate for folders?


Adding another study should force a plate mapper update

This currently doesn't happen, but it would make sense to have this sort of functionality available (discussed this with @charles-cowart).
As an example: say the user enters in some specimen IDs associated with "Study 1", but no studies have been added for the given plate yet. These IDs would all show up with a red candy-stripe background.
If the user then adds Study 1, these specimen IDs will remain with a red candy-stripe background. This will only change when the user forces an update by changing individual IDs to something else, then changing those IDs back.

Implementing this shouldn't be too difficult (on adding a study, force a refresh of all of the wells), but I'm not familiar enough with this code to say how easy it'll be to go from pseudocode to implementation.


As a volunteer coordinator, I want to check the description of an event

...so that I can have a better idea of the details of the event..

eshow


Excel file not opening on every plateform with Node

Hello, I am currently struggling with opening the file generated by exceljs (v1.7.0) on MS Excel. I can open it but Excel (v16.21.1) says that some styling were not imported and no styling is taken into account.

[EN Traduction] - "Sorry... We found a problem in the file, but we can try to recover as much content as we can. If you trust were the file came from, click yes"
That gives me this Excel that doesn't take all my styling:

If I try to open the file in the browser with the extension Office Editing for Docs, Sheets & Slides it shows me this error:

BUT if I manually create a Google spreadsheet and import from there my generated file, the file is correctly displayed and opens correctly:

And kind of weird, but I generate the file, opens it on Google spreadsheet, download it from there on xlsx format and opens this downloaded file, the file opens correctly. So Google must be doing something I am not. As most of my users will be using Excel, it's kind of annoying to push them to use Spreadsheet.
Here is the code that I use to  generate and style my file
  const workbook = new Excel.Workbook()

  // Worksheet
  const worksheet = workbook.addWorksheet('Detailed capitalization table', {
    pageSetup: { paperSize: 9, orientation: 'landscape', },
  })

  worksheet.views = [
    { state: 'frozen', ySplit: 4, topLeftCell: 'A3', },
    {
      showGridLines: false,
    },
  ]

  // Construction of columns
  // Construction of frozen upper part
  // Put data into columns

And later I do
workbook.xlsx.writeFile('path/to/file.xlsx') // With path to file

I tried without any styling but even then it doesn't work. Still errors when i try to open the file.
Thanks for reading, if you have any lead that would be super helpful!

We actually have the same issue, I cannot get rid of the warning message when opening generated files with MS Excel but opening it in Google drive work fine.
I also lose some styling in Excel.

honestly in some files I have same issue, I didn't point  source of this error ;( If You have any idea what is the reason I will be really thankful ;)

This message can be caused by an incorrect order of some nodes in internal styles.xml/sheet1.xml/... files, or by an incomplete set of values, or by an incorrect (non xml) content in these files... To investigate such issues, I tried to create as simple content as possible and to save it. Then, I created the same content manually in Excel, saved it and compared the resulting files.
In your code, the state: 'frozen' option seems to be the source of that error message. It seems that you want to initialize the '<IP_ADDRESS> pane (View Pane)' object (see Office Open XML File Formats for more details) that is represented by the Frozen View ExcelJS entity.
Adjust it in MS Excel manually, save changes into XLSX file and compare it with the generated ExcelJS file.
Don't hezitate to adjust another approach to investigate this issue if I mistunderstood the initial scenario or ExcelJS implementation details.

Hi,
I've created a worksheet with nothing on it, but I still get the errors.
Here is the code :
  const workbook = await new Excel.Workbook()
  const worksheet = await workbook.addWorksheet('Worksheet')
  workbook.xlsx.writeFile('path/to/file.xlsx') // With path to file
}

Here is the xml that results from the generated xlsx file:
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<Types xmlns="http://schemas.openxmlformats.org/package/2006/content-types">
<Default Extension="rels" ContentType="application/vnd.openxmlformats-package.relationships+xml"/>
  <Override PartName="/xl/workbook.xml" ContentType="application/vnd.openxmlformats-officedocument.spreadsheetml.sheet.main+xml"/>
  <Override PartName="/xl/worksheets/sheet1.xml" ContentType="application/vnd.openxmlformats-officedocument.spreadsheetml.worksheet+xml"/>
  <Override PartName="/xl/theme/theme1.xml" ContentType="application/vnd.openxmlformats-officedocument.theme+xml"/>
  <Override PartName="/xl/styles.xml" ContentType="application/vnd.openxmlformats-officedocument.spreadsheetml.styles+xml"/>
  <Override PartName="/docProps/core.xml" ContentType="application/vnd.openxmlformats-package.core-properties+xml"/>
  <Override PartName="/docProps/app.xml" ContentType="application/vnd.openxmlformats-officedocument.extended-properties+xml"/>
</Types>

And here is the xml when I import the xlsx on Google Spreadsheet and download it in xlsx from there:
<?xml version="1.0" encoding="UTF-8" standalone="yes"?>
<Types xmlns="http://schemas.openxmlformats.org/package/2006/content-types">
<Default ContentType="application/xml" Extension="xml"/>
  <Default ContentType="application/vnd.openxmlformats-package.relationships+xml" Extension="rels"/>
  <Override ContentType="application/vnd.openxmlformats-officedocument.spreadsheetml.worksheet+xml" PartName="/xl/worksheets/sheet1.xml"/>
  <Override ContentType="application/vnd.openxmlformats-officedocument.spreadsheetml.sharedStrings+xml" PartName="/xl/sharedStrings.xml"/>
  <Override ContentType="application/vnd.openxmlformats-officedocument.drawing+xml" PartName="/xl/drawings/drawing1.xml"/>
  <Override ContentType="application/vnd.openxmlformats-officedocument.spreadsheetml.styles+xml" PartName="/xl/styles.xml"/>
  <Override ContentType="application/vnd.openxmlformats-officedocument.spreadsheetml.sheet.main+xml" PartName="/xl/workbook.xml"/>
</Types>

The error is definitely in this, as I can open the xlsx generated from Google Spreadsheet no problem. If you have any idea of how I can make this work, thousand thanks. I just really want this to work.

I have checked how ExcelJS exports empty xlsx file from a browser and my MS Excel 2013 opened it without error messages. It seems there are differences between ExcelJS codes for browsers and for Node. I cannot check Node scenario in a short time but hope my codepen projects will help manage both issues.

Yes I'm using Node and this might be the issue. From a browser it works perfectly but as you said there must be some confusion in the order of the calls. I'm trying to figure out how all of this works, could you keep me updated on your check of the Node scenario? Thanks for the help

Hi, I'm still having difficulties with opening the file, I feel like I have tried a lot of different options. If anyone has a working example on Node I can try to debug from there and maybe fix.

+1!

Hi,
Upon closer inspection the excel generated in the codepen of @IgnatovDan is not working either. When I try to open it I get this error:

We have the same problem. Is there any news on this issue ?

Could you please publish your incorrect XLSX file so I can check how Excel2013 and Office365Excel will open it and investigate what is incorrect?
This information can help us make changes in ExcelJS sources.

I'm having a similar problem, except the file can be somewhat repaired by the excel dialog. I still want to get rid of whatever is causing this popup though...

i use writeBuffer() function.Need "file-saver" lib

workbook.xlsx.writeBuffer().then(function(buffer) {
// done
saveAs(new Blob([buffer], {
type: "application/octet-stream"
}), example.xlsx);
console.log('excel export success');
});

Hey Community,
is there any progress on this open issue? I also tried to use the library with Node.
I made some tests but without success.
Here my setup:

MacOs
Node 12.16.1
exceljs 3.9.0
Microsoft Excel for Mac Version 16.35

I created an empty worksheet and saved it in different ways, but no file can be opened with Excel.
Even it cannot be repaired!
let Excel = require('exceljs');
let fs = require('fs');
//-------------------------------------------------------------------------------------
const workbookStream  = new Excel.Workbook();
const writeStream = fs.createWriteStream('./test-stream.xlsx');
workbookStream.xlsx.write(writeStream)
    .then(() => writeStream.end())
    .then(() => writeStream.close());
//-------------------------------------------------------------------------------------
const workbookFile  = new Excel.Workbook();
workbookFile.xlsx.writeFile('./test-file.xlsx')
//-------------------------------------------------------------------------------------
const workbookBuffer  = new Excel.Workbook();
workbookBuffer.xlsx.writeBuffer()
    .then(buffer => {fs.promises.writeFile('./test-buffer.xlsx', Buffer.from(buffer));
});

The attached file is an example of the output, which was generated.
test-file.xlsx

Hi @szilch, I'm facing the same issue. Did you find any solution on your own ?

I solved the problem. Hope this helps you.
If you download this excel file from the server side (In my case Node JS).
The problem is solved by one line on the client side:  req.responseType = "arraybuffer";
requestData(req, "exportToExcel")
            .then(resXHR => {
                // For the correct processing of data from the server, you must specify the format/structure of data transfer
                resXHR.responseType = "arraybuffer"
                // Wait until the data is downloaded from the server
                resXHR.onload = function () {
                    // Call a modal window for saving with type and file name
                    saveAs(new Blob([resXHR.response], { type: 'application/vnd.openxmlformats-officedocument.spreadsheetml.sheet' }), 'users.xlsx')
                }
            })

Facing the same issue when I'm trying to edit an existing excel sheet, to fix this I've done all the updates on the existing workbook and before sending the response/uploading I'm creating another workbook and looping all the sheets, rows and cell and adding the respective data and styles from the old workbook.
    let newWorkbook = new Excel.Workbook();
    oldWorkbook.eachSheet(function(worksheet: any) {
      let newSheet = newWorkbook.addWorksheet(worksheet.name);
      worksheet.eachRow(function(row: any) {
          newSheet.addRow(row.values)
      })
   })

This is for sure not the optimal way of fixing but can help you in getting unblocked, please do mind to add your row styles or cell styles while iterating to elements.
If we think about having a standard function that can take care of all this? I'll try to come up with one if anybody needs it.

Hey guys, what can we do to speed this up?

Faced the same issue. Find out it was because I copied a model of a different worksheet (blueprint) and by doing this the name of the worksheet (sheet) didn't match anymore with the name I created, resetting the name to the original one fixed it for me!
var sheet = wb.addWorksheet(originalName);  sheet.model = Object.assign(blueprintSheet.model,       {mergeCells: blueprintSheet.model.merges});   sheet.name = orginialName;
I hope this helps anyone!

I encounter the same issue. Impossible to open the generated file (even a very basic one with an empty workbook) with Excel without a corrupted file warning. It opens properly in other software like libre office, google spdreadshit, wps, etc.
I only tested to generate file from node (not from the browser).

I'm also having this error on node without "Enabling editing" manually in Excel

did you fix this issue? i am having this too, using ...writeFile().

Hello. My file is formed on the backend using writeBuffer() and then transferred to the frontend. I use the buffer because in this format the server transmits data to the UI.
Here's the code for handling this buffer on the frontend side - https://github.com/exceljs/exceljs/issues/739#issuecomment-629535077

Hi all,
is there any news to this problem? I am having the same problem:

Create the file in the backend on a request of the frontend using workbook.xlsx.writeBuffer()
The response includes the following headers:{
  'Content-Type': 'application/vnd.openxmlformats-officedocument.spreadsheetml.sheet; charset=utf-8',
  'Content-Disposition': `attachment; filename=test.xlsx`,
}

When trying to open the file using MS Excel on Windows, I get a warning that the file is corrupted.

I tried this code (thanks to @szilch and his 'test-file.xlsx' file):
      var workbook = new ExcelJS.Workbook();

      workbook.xlsx.writeBuffer().then(function(buffer) {
          saveAs(new Blob([buffer], { type: 'application/octet-stream' }), 'Employees.xlsx');
      });

in my online demo at https://js.devexpress.com/Demos/WidgetsGallery/Demo/DataGrid/ExcelJSOverview/jQuery/Light/ and MSExcel2013 shows the "We found a problem with some content in 'Employees.xlsx'" when opening the generated XLSX file.
However, the following code:
      var workbook = new ExcelJS.Workbook();
      var worksheet = workbook.addWorksheet('Employees');

      workbook.xlsx.writeBuffer().then(function(buffer) {
          saveAs(new Blob([buffer], { type: 'application/octet-stream' }), 'Employees.xlsx');
      });

generates a correct file and MSExcel opens it without errors.
It seems that MSExcel cannot open a file without a workbook.

I tried this code (thanks to @szilch and his 'test-file.xlsx' file):
      var workbook = new ExcelJS.Workbook();

      workbook.xlsx.writeBuffer().then(function(buffer) {
          saveAs(new Blob([buffer], { type: 'application/octet-stream' }), 'Employees.xlsx');
      });

in my online demo at https://js.devexpress.com/Demos/WidgetsGallery/Demo/DataGrid/ExcelJSOverview/jQuery/Light/ and MSExcel2013 shows the "We found a problem with some content in 'Employees.xlsx'" when opening the generated XLSX file.
However, the following code:
      var workbook = new ExcelJS.Workbook();
      var worksheet = workbook.addWorksheet('Employees');

      workbook.xlsx.writeBuffer().then(function(buffer) {
          saveAs(new Blob([buffer], { type: 'application/octet-stream' }), 'Employees.xlsx');
      });

generates a correct file and MSExcel opens it without errors.
It seems that MSExcel cannot open a file without a worksheet.

Unfortunately, this does not solve my issue as I am already creating a worksheet in my code:
const workbook = new Workbook()
const sheet = workbook.addWorksheet(worksheetTitle)

// add rows + styling ...

return workbook.xlsx.writeBuffer()

Would you pls share your minimized xlsx file and source code? I can check it in my environment.

I could fix my problem. For all who stumble upon this issue, maybe the following will help:

I had cells with text of a percentage in it (e.g. "50%"). Excel tried to parse them automatically which led to an error. I switched to insert them as a number (e.g. 0.5) and configured it to being displayed as a percentage (0%)
I also had a table which I gave a name that had a space in it (e.g. "test table"). It seems that Excel does not allow that (when repairing the file, Excel replaces the space with an underscore)
I also used the autoFilter feature on the table, which led to an error. I switched to enabling the filter buttons directly for each column of the table

I face the similar problem. I tried to update excel file asynchronously from multiple places in my code simultaneously. If we try to open the file in read mode when it was in write mode already, it'll make the file corrupted.
I was stuck in the below error.
Error Error: Corrupted zip or bug: expected 16 records in central dir, got 0     at ZipEntries.readCentralDir (/node_modules/jszip/lib/zipEntries.js:146:23)     at ZipEntries.load (/node_modules/jszip/lib/zipEntries.js:257:14)     at /node_modules/jszip/lib/load.js:48:24     at processTicksAndRejections (node:internal/process/task_queues:96:5)     at async XLSX.load (/node_modules/exceljs/lib/xlsx/xlsx.js:279:17)     at async XLSX.readFile (/node_modules/exceljs/lib/xlsx/xlsx.js:55:24)
I carefully gone through my code and found that I've been asynchronously calling update excel method multiple times simultaneously. I made it to be synchronous and removed unwanted code calling update excel method. This fixes my problem.

I also facing the same issue.  I try to open the file using office 365 and found out that my Excel is empty.
I solve the problem by adding await in the write function
await workbook.xlsx.writeFile('filename.xlsx')


Use default context output rather than outputWithTimestamp for ElasticsearchIO

Using ProcessContext#outputWithTimestamp is more fragile than output, and explicit use of outputWithTimestamp is not required in the case of ES module; in fact, code is currently trying to emulate output by storing and recalling element timestamps. This change is being made after finding an issue with timestamp validation when starting a pipeline from a snapshot that could have been avoided with this change.
Please add a meaningful description for your change here

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

[ ] Choose reviewer(s) and mention them in a comment (R: @username).
[ ] Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
[ ] Update CHANGES.md with noteworthy changes.
[ ] If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

GitHub Actions Tests Status (on master branch)

See CI.md for more information about GitHub Actions CI.

R: @echauchot

@egalpin I thought this PR was only for cosmetics, but I see that it is linked to BEAM-14064 if I understood correctly. For next time, if it is linked with an open issue, remember to put the jira ticket in the commit. I'll not reword as it is already merged to master

Will do @echauchot 👍 This change was made and merged prior to BEAM-14064, but I think it would have been useful for me to document the reason for my fix in Jira anyway. Thanks for the reminder!

I think this is still incorrect as the Document will be assigned to an arbitrary window and timestamp.

I agree that it's sub-optimal.  I do feel that having this change is far better than not, otherwise ElasticsearchIO#write will be unusable.  Ideally, I'll be able to fix the data correctness issue before 2.38.0 release after getting advice on the dev@ mailing list for best practices.

I thought this was considered the final fix so thanks for confirming that this is only a partial improvement and that your looking at fixing it completely.


Remove local database

Description
Please include a summary of the changes and the related issue.
Type of change

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Documentation update

How Has This Been Tested?
Please describe the tests that you ran to verify your changes.
Checklist:

[ ] I have commented my code, particularly in hard-to-understand areas
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works

Current dependencies on/for this PR:

develop

PR #47   👈

PR #48

PR #49

PR #50

This stack of pull requests is managed by Graphite.

Merge activity

Nov 7, 11:59 PM: @akotadi started a stack merge that includes this pull request via Graphite.


Back-End: Create Asset Requests

Controller, Services, Requests, Model, Repository

Created backend for Asset Requests.


get RHI texture size to fix crash

'if' check is not compulsory, but we are goig with it to avoid engine's ensure deeper

Please let me know about the fix next time, before I suffer with the branches)
BR
Anton

From: Dejan Jovasevic @.>
Sent: Monday, October 16, 2023 1:16 PM
To: DolbyIO/comms-sdk-unreal @.>
Cc: Anton Iovbak @.>; Mention @.>
Subject: Re: [DolbyIO/comms-sdk-unreal] get RHI texture size to fix crash (PR #422)
@djova-dolby commented on this pull request.

In DolbyIO/Source/Private/Video/DolbyIOVideoTexture.cpphttps://github.com/DolbyIO/comms-sdk-unreal/pull/422#discussion_r1360440801:

@@ -109,12 +109,21 @@ namespace DolbyIO
[SharedThis = AsShared()](FRHICommandListImmediate& RHICmdList)
{
FScopeLock Lock{SharedThis->GetBufferLock()};

                      auto FRHITexture2D_Ptr = SharedThis->Texture->GetResource()->GetTexture2DRHI();

                      uint32 SizeX = FRHITexture2D_Ptr->GetSizeX(), SizeY = FRHITexture2D_Ptr->GetSizeY();

                      RHIUpdateTexture2D(FRHITexture2D_Ptr, 0,

                                         FUpdateTextureRegion2D{0, 0, 0, 0, SizeX, SizeY},

                                         SizeX * Stride, SharedThis->GetBuffer());

              });

                          const auto TextureRegion = FUpdateTextureRegion2D{0, 0, 0, 0,

                                                                                static_cast<uint32>(SharedThis->Texture->GetResource()->GetTexture2DRHI()->GetSizeX()),

                                                                                static_cast<uint32>(SharedThis->Texture->GetResource()->GetTexture2DRHI()->GetSizeY())};

                          if (TextureRegion.DestX + TextureRegion.Width <= static_cast<uint32>(SharedThis->Texture->GetResource()->GetTexture2DRHI()->GetSizeX()) &&

I think this is redundant is it not? DestX is 0 because you have created the region with 0 and Width will be SizeX() of the RHI texture as seen in the constructor. FUpdateTextureRegion2Dhttps://docs.unrealengine.com/4.27/en-US/API/Runtime/RHI/FUpdateTextureRegion2D/__ctor/2/ is created with. Similarly for height/sizeY(). Thus I think this issue was already fixed with what was there previously in this commithttps://github.com/DolbyIO/comms-sdk-unreal/commit/7fdc061934cb275db988e6082797ba415e7a1002 following your suggestion where it was made to use the RHI textures for size:
FScopeLock Lock{SharedThis->GetBufferLock()};
auto FRHITexture2D_Ptr = SharedThis->Texture->GetResource()->GetTexture2DRHI();
uint32 SizeX = FRHITexture2D_Ptr->GetSizeX(), SizeY = FRHITexture2D_Ptr->GetSizeY();
RHIUpdateTexture2D(FRHITexture2D_Ptr, 0,
FUpdateTextureRegion2D{0, 0, 0, 0, SizeX, SizeY},
SizeX * Stride, SharedThis->GetBuffer());
—
Reply to this email directly, view it on GitHubhttps://github.com/DolbyIO/comms-sdk-unreal/pull/422#pullrequestreview-1679621260, or unsubscribehttps://github.com/notifications/unsubscribe-auth/BCQROF6XEZDTVICUSKIF4LTX7UCOXAVCNFSM6AAAAAA6B5FO22VHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMYTMNZZGYZDCMRWGA.
You are receiving this because you were mentioned.Message ID: @.***>


[ST-704] add cypress test runner

cypress JUnit reporter outputs incorrect format(https://github.com/cypress-io/cypress/issues/8237), so we can't use file command.
I create a cypress plugin for that.
I need some testsuites elements to get the test file name that use to report, so I define testsuites method that can overwrite.
And I prepare custom testsuites method for cypress.
outputed XML: https://github.com/launchableinc/cli/pull/101/files#diff-57f8b2c67ad176f3307742a51acc476264050670ebe13c6492441fd17596f971

I'm saying this without fully understanding this change, but ...
The thing that gives me a pause is the tweak to RecordTests. The testsuites indirection wasn't obvious to me. It is ostensibly to map JUnit-esque objects to a list of TestSuite, but it's actually used to manipulate the parsed JUnit report before it gets processed. That use case is understandable, and for that it's more straightforward to provide an indirection around JUnitXml.fromfile(p).

I'm saying this without fully understanding this change, but ...
The thing that gives me a pause is the tweak to RecordTests. The testsuites indirection wasn't obvious to me. It is ostensibly to map JUnit-esque objects to a list of TestSuite, but it's actually used to manipulate the parsed JUnit report before it gets processed. That use case is understandable, and for that it's more straightforward to provide an indirection around JUnitXml.fromfile(p).

The testsuites indirection wasn't obvious to me. It is ostensibly to map JUnit-esque objects to a list of TestSuite, but it's actually used to manipulate the parsed JUnit report before it gets processed.

Yes, exactly true. I think this method's name and way aren't the best too.

That use case is understandable, and for that it's more straightforward to provide an indirection around JUnitXml.fromfile(p).

you mean,  we use JUnitXML.fromfile method basically but when we have to parse invalid formats, we provide a custom method that returns was parsed, and formatted XML elements object and override the method?

The testsuites indirection wasn't obvious to me. It is ostensibly to map JUnit-esque objects to a list of TestSuite, but it's actually used to manipulate the parsed JUnit report before it gets processed.

Yes, exactly true. I think this method's name and way aren't the best too.

That use case is understandable, and for that it's more straightforward to provide an indirection around JUnitXml.fromfile(p).

you mean,  we use JUnitXML.fromfile method basically but when we have to parse invalid formats, we provide a custom method that returns was parsed, and formatted XML elements object and override the method?

You modified (or more precisely "normalized") the XML file in walking test suites processing processing process. IMO,if you need to modify the XML file you can write a converter such as normalized_xml = some_converter(JUnitXML.fromFile(p)).

You modified (or more precisely "normalized") the XML file in walking test suites processing processing process. IMO,if you need to modify the XML file you can write a converter such as normalized_xml = some_converter(JUnitXML.fromFile(p)).

That use case is understandable, and for that it's more straightforward to provide an indirection around JUnitXml.fromfile(p).

you mean, we use JUnitXML.fromfile method basically but when we have to parse invalid formats, we provide a custom method that returns was parsed, and formatted XML elements object and override the method?

Exactly!

That use case is understandable, and for that it's more straightforward to provide an indirection around JUnitXml.fromfile(p).

you mean, we use JUnitXML.fromfile method basically but when we have to parse invalid formats, we provide a custom method that returns was parsed, and formatted XML elements object and override the method?

Exactly!


Cleaning filenames

File names submitted are used raw on the command. Cleaning should be done.

File uploads are removed


DCOS-52770 - ServicesTable: remove dead code

this is a prototypical commit message for a series of spikes.
find specific things to pay attention to on the end of this message. also there's a general bunch of things that might be in here:

remove dead code and its dependencies
convert stuff to ES6-syntax
convert imports/exports to ES6
move functions out of classes (to emphasize that they are not methods)
simplification of boolean expressions
usage of early returns to decrese indentation level

i grep every function/method and try to find out whether it is still in use. if not, it is deleted. at the end i browse the UI to see whether stuff still works.
Testing
convince yourself that no functionality has been broken. on a mechanical level this can be done by also greping for stuff or digging through history using git blame. on the QA-level it seems that clicking through the UI is the way to go.

removed functions/methods:

getOpenInNewWindowLink
getImage
renderServiceActions

it looks like those have been moved into ServicesTable${prop}Column.

This will probably clash with https://github.com/dcos/dcos-ui/pull/3805 .

Waiting to update branch until

[ ] https://github.com/dcos/dcos-ui/pull/3764
[ ] https://github.com/dcos/dcos-ui/pull/3764

are merged

I resolved conflicts

:tada: This PR is included in version 2.89.3 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


grouped-bar-chart legend needs to work on page resize

the position attribute need to update when the window dimension changes - to reproduce, resize the window in the horizontal dimension and notice how the legend currently redraws itself in a new position.

fixed by contextual axes PR


RuntimeError: CUDNN_STATUS_EXECUTION_FAILED

I've installed the correct requirements. But after running this:
python main.py --dataset cifar10 --arch vgg --depth 16
I'm getting the following error:
Traceback (most recent call last):
  File "main.py", line 166, in <module>
    train(epoch)
  File "main.py", line 125, in train
    output = model(data)
  File "/home/jeferson/repo/rethinking-network-pruning/repense/lib/python3.6/site-packages/torch/nn/modules/module.py", line 357, in __call__
    result = self.forward(*input, **kwargs)
  File "/home/jeferson/repo/rethinking-network-pruning/cifar/l1-norm-pruning/models/vgg.py", line 56, in forward
    x = self.feature(x)
  File "/home/jeferson/repo/rethinking-network-pruning/repense/lib/python3.6/site-packages/torch/nn/modules/module.py", line 357, in __call__
    result = self.forward(*input, **kwargs)
  File "/home/jeferson/repo/rethinking-network-pruning/repense/lib/python3.6/site-packages/torch/nn/modules/container.py", line 67, in forward
    input = module(input)
  File "/home/jeferson/repo/rethinking-network-pruning/repense/lib/python3.6/site-packages/torch/nn/modules/module.py", line 357, in __call__
    result = self.forward(*input, **kwargs)
  File "/home/jeferson/repo/rethinking-network-pruning/repense/lib/python3.6/site-packages/torch/nn/modules/conv.py", line 282, in forward
    self.padding, self.dilation, self.groups)
  File "/home/jeferson/repo/rethinking-network-pruning/repense/lib/python3.6/site-packages/torch/nn/functional.py", line 90, in conv2d
    return f(input, weight, bias)
RuntimeError: CUDNN_STATUS_EXECUTION_FAILED

Am I doing something wrong?

Are you using torch v0.3.1?

Are you using torch v0.3.1?

Yes! I created a virtual environment in which I installed the required dependencies. When I tried to run the above command I fell into a problem with the CUDA_VERSION.
... requires CUDA_VERSION >= 9000 for
optimal performance and fast startup time, but your PyTorch was compiled
with CUDA_VERSION 8000. Please install the correct PyTorch binary
using instructions from http://pytorch.org

So I went to python.org and got the following pytorch build version https://download.pytorch.org/whl/cu90/torch-0.3.1-cp36-cp36m-linux_x86_64.whl  and it starts to run but  the above error occurs.

Not sure what your problem is. Does running resnet also cause the same problem? If so, then it may be something related to your environment.

Not sure what your problem is. Does running resnet also cause the same problem? If so, then it may be something related to your environment.

It happens the same. I think the problem is related to my cuda version, which is currently version 10.0.

Maybe the CUDA version is the cause.

When I use torch v0.4.0, despite some errors like the ones shown below, training apparently starts normally.
rethinking-network-pruning/cifar/l1-norm-pruning$ python main.py --dataset cifar10 --arch vgg --depth 16
Files already downloaded and verified
THCudaCheck FAIL file=/pytorch/aten/src/THC/THCGeneral.cpp line=844 error=11 : invalid argument
main.py:127: UserWarning: invalid index of a 0-dim tensor. This will be an error in PyTorch 0.5. Use tensor.item() to convert a 0-dim tensor to a Python number
  avg_loss += loss.data[0]
main.py:135: UserWarning: invalid index of a 0-dim tensor. This will be an error in PyTorch 0.5. Use tensor.item() to convert a 0-dim tensor to a Python number
  100. * batch_idx / len(train_loader), loss.data[0]))
Train Epoch: 0 [0/50000 (0.0%)]	Loss: 2.304134
Train Epoch: 0 [6400/50000 (12.8%)]	Loss: 2.072424
Train Epoch: 0 [12800/50000 (25.6%)]	Loss: 1.590183
Train Epoch: 0 [19200/50000 (38.4%)]	Loss: 1.610837
Train Epoch: 0 [25600/50000 (51.2%)]	Loss: 1.439363
Train Epoch: 0 [32000/50000 (63.9%)]	Loss: 1.510963
Train Epoch: 0 [38400/50000 (76.7%)]	Loss: 1.700880
Train Epoch: 0 [44800/50000 (89.5%)]	Loss: 1.284431
main.py:144: UserWarning: volatile was removed and now has no effect. Use `with torch.no_grad():` instead.
  data, target = Variable(data, volatile=True), Variable(target)
main.py:146: UserWarning: invalid index of a 0-dim tensor. This will be an error in PyTorch 0.5. Use tensor.item() to convert a 0-dim tensor to a Python number
  test_loss += F.cross_entropy(output, target, size_average=False).data[0] # sum up batch loss

Test set: Average loss: 1.1723, Accuracy: 5790/10000 (57.0%)

Train Epoch: 1 [0/50000 (0.0%)]	Loss: 1.202878
Train Epoch: 1 [6400/50000 (12.8%)]	Loss: 1.249835
Train Epoch: 1 [12800/50000 (25.6%)]	Loss: 1.410513
Train Epoch: 1 [19200/50000 (38.4%)]	Loss: 1.196959
...

Okay. Then it may be that CUDA 10.0 is more suitable for torch v0.4.0.

If you want to use CUDA >= 0.92, The code should be changed for Pytorch 0.4.1.
Here is the source code I converted https://github.com/songheony/rethinking-network-pruning.
I've tested it with Pytorch 1.2, CUDA 10

If you want to use CUDA >= 0.92, The code should be changed for Pytorch 0.4.1.
Here is the source code I converted https://github.com/songheony/rethinking-network-pruning.
I've tested it with Pytorch 1.2, CUDA 10

I'll check it out!


Why doesn't the spellchecker have Hungarian?

Doesn't it come from chromium? Chrome comes in Hungarian.
I see other uncommon languages (some less populous even) such as Slovak, Serbian, Romanian. There are a dozen form of spanish and english variants...

What's your operating system?

Hungarian added in next release

@aluxian commented on Mar 23, 2017, 12:41 PM GMT+1:

What's your operating system?

Windows 8.1
@aluxian commented on Mar 23, 2017, 12:44 PM GMT+1:

Hungarian added in next release

Great!

So I selected hungarian, but it doesn't seem to work. It never underlines anything, and there are no suggestions.


Can we edit models, add custom dots or iicons on model with this package?

Need to use this package for an app where  users can add there home model and select empty area. is this feasible? a small example woud be great. thanks

This package is based on model viewer, which is just for displaying interactive 3D models, for example, drag to see different angles.
Sorry but I think your needs of "interactive with the home model" may not be met.


Remove microbuild library location from the Signing process

Tagging @dotnet/project-system for review

ping @dotnet/project-system?


Made changes for vue3sfcloader compatibility

Closes #128
Summary
The watchers needed to be updated.
There were some k-inputs that were only being used for display data, so I disabled the ability to write text into them.
Local Tests
After applying the changes I no longer got the errors.

@rmotitsuki I just finished this PR, and it's ready for review.


refactor: remove throws from health route and route utils

Pull Request Checklist
Task Description/Number

Issue Number: DEV-2041
Basic Requirements
Please check if your PR fulfills the following requirements:

[ ] Tests for the changes have been added (for bug fixes / features)
[ ] Docs have been added / updated (for bug fixes / features)

PR Type
What kind of change does this PR introduce?

[ ] fix: represents bug fixes
[x] refactor: represents production code refactoring
[ ] feat: represents a new feature
[ ] docs: documentation changes (no production code change)
[ ] chore: maintenance tasks (no production code change)
[ ] test: all about tests: adding, refactoring tests (no production code change)
[ ] other... Please describe:

Does this PR introduce a breaking change?

[ ] Yes
[x] No
[ ] Maybe (not 100% sure => check with FE)

Does this PR change client-test-data?

[ ] Yes (don't forget to update the JS-LIB team about the change)
[x] No

@seakayone thanks for the review, I applied some of the suggestions; on others I had some questions, see my comments for that. I'm happy to change more, once I fully understand :)


chore: hide view follows link on the toast on the onboarding grid

This PR resolves []
Description

Hide view follows link on the toast on the onboarding grid. When on onboarding, the navigation is not initialized yet and navigation will not work

Onboarding grid
Another grid

PR Checklist

[] I have tested my changes on iOS and Android.
[x] I hid my changes behind a feature flag, or they don't need one.
[x] I have included screenshots or videos, or I have not changed the UI.
[x] I have added tests, or my changes don't require any.
[ ] I added an app state migration, or my changes do not require one.
[ ] I have documented any follow-up work that this PR will require, or it does not require any.
[ ] I have added a changelog entry below, or my changes do not require one.

To the reviewers 👀

[ ] I would like at least one of the reviewers to run this PR on the simulator or device.

Changelog updates
Changelog updates

Cross-platform user-facing changes

hide view follows link on the toast shown on the onboarding grid

iOS user-facing changes

Android user-facing changes

Dev changes

Need help with something? Have a look at our docs, or get in touch with us.

Removing the description as well as it feel odd to have it without the link. I think, description is a call to action, but there is no action without the view follows link


Add faster ZIP

Codecov Report
Attention: Patch coverage is 88.42105% with 11 lines in your changes are missing coverage. Please review.

Project coverage is 82.74%. Comparing base (a92ada5) to head (486a94d).

Files
Patch %
Lines

preliz/distributions/zi_poisson.py
87.64%
11 Missing :warning:

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #360      +/-   ##
==========================================
- Coverage   82.79%   82.74%   -0.06%
==========================================
  Files          53       54       +1
  Lines        5156     5158       +2
==========================================
- Hits         4269     4268       -1
- Misses        887      890       +3

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


Test suite 2

I Decided to make a second PR, the first one is a little bit cloudy.

Thanks, I think this is really nice. I like how the text files focus on just the tests: should be easy to maintain and add tests to.
NAME username
RUN bpftrace -e 'i:ms:1 { printf("SUCCESS '$test' %s\n", username); exit(); }'
EXPECT SUCCESS username .*
TIMEOUT 5

NAME probe
RUN bpftrace -e 'k:do_nanosleep { printf("SUCCESS '$test' %s\n", probe); exit(); }'
EXPECT SUCCESS probe kprobe:do_nanosleep
TIMEOUT 5
BEFORE sleep 1 && sleep 1 &

NAME curtask
RUN bpftrace -e 'i:ms:1 { printf("SUCCESS '$test' %d\n", curtask); exit(); }'
EXPECT SUCCESS curtask -?[0-9][0-9]*
TIMEOUT 5

:-)

I like it. I tested and had 7 failures out of 62 tests, and I've debugged why and have the suggested fixes below for 4 of them. If you can get them fixed, I'll merge this and we can chase down the remaining 3 later (one of which I think is just a kernel version difference).
Here's the failures on my machine:
join ERROR
	Expected: echo A
	Found: Attaching 2 probes...

Error loading program: interval:ms:1 (try -v)

uprobe  TIMEOUT
uretprobe  TIMEOUT

join
Suggested fix:
EXPECT A

str
I don't know what's up there. I'm on 4.15 x86_64, and it's printing arg1 not arg0. Maybe sys_execve() changed on this kernel version?
sym
Possible regression. This works:
sudo ./src/bpftrace -e 'kprobe:do_nanosleep { @[reg("ip"), sym(reg("ip"))] = count(); }'
Attaching 1 probe...
^C

@[-1160134639, do_nanosleep]: 215

But this doesn't:
sudo ./src/bpftrace -e 'kprobe:do_nanosleep { printf("got: %llx %s\n", reg("ip"), sym(reg("ip"))); exit();}'
Attaching 1 probe...
got: ffffffffbad9c011

global_associative_arrays
Suggested fix:
NAME global_associative_arrays
RUN bpftrace -e 'k:do_nanosleep { @start[tid] = nsecs; } kretprobe:do_nanosleep /@start[tid] != 0/ { printf("slept for %d ms\n", (nsecs - @start[tid]) / 1000000); delete(@start[tid]); exit();}'
EXPECT slept for [0-9]+ ms
TIMEOUT 5
BEFORE (sleep 1; sleep 1) &

I think I fixed the intent of the BEFORE command as well: it schedules a "sleep 1" that should run while tracing (unless another sleep happened in the meantime).
cgroups
I think my kernel version is just too old for this BPF function, so ignore this failure for now.
Attaching 1 probe...

Error log:
0: (bf) r6 = r1
1: (b7) r1 = 0
2: (7b) *(u64 *)(r10 -16) = r1
3: (85) call unknown#80
invalid func unknown#80

Error loading program: interval:ms:1

uprobe & uretprobe
These expect some bash readline()s, but that won't happen unless someone is interactive.
Suggested fix:
NAME uprobe
RUN bpftrace -e 'uprobe:/bin/bash:echo_builtin { printf("arg0: %d", arg0); exit();}'
EXPECT arg0: [0-9]*
TIMEOUT 5
BEFORE (sleep 1; /bin/bash -c echo) &

NAME uretprobe
RUN bpftrace -e 'uretprobe:/bin/bash:echo_builtin { printf("readline: %d\n", retval); exit();}'
EXPECT readline: [0-9]*
TIMEOUT 5
BEFORE (sleep 1; /bin/bash -c echo) &

I think I need to add some tests for BEGIN and END

We can close this, right, since we merged the other one?

We can close this, right, since we merged the other one?

#226 was closed in favor of this Pull Request. Or do you mean another PR?

Oh, I was confused. Are we ready to merge this one?

Code-wise I think this can be merged (we can make further improvements in follow-up PRs), but I would like to see this running on Travis before merging it (right now only unit tests are running there).

Wouldn't it be easier to merge first, then setup Travis after?

Tests are passing on CI with those latest changes. Merging...


fix: mvp-demo: update default ECP to enterprise-contract-service/default

Description
mvp-demo: update default ECP to enterprise-contract-service/default
the ecp.Source should be from quay.io bundle
sources:
  - data:
    - oci::quay.io/hacbs-contract/ec-policy-data:git-0ba79c3@sha256:6f55c7887f0ed449c23d681514f43d841ed5ccb58b538fa924665ec53de1a169
    name: Release Policies
    policy:
    - oci::quay.io/hacbs-contract/ec-release-policy:git-a2d0125@sha256:ddfa0fd1c813a69cfbc226517d89372ad7b30461708045c21962ac0ebbb930ec

not from git repo.
{
	Name: "ec-policies",
	Policy: []string{
		"git::https://github.com/enterprise-contract/ec-policies.git//policy",
	},
	Data: []string{
		"git::https://github.com/enterprise-contract/ec-policies.git//data"，
	},
}

Issue ticket number and link
https://issues.redhat.com/browse/HACBS-2027
Type of change

[ ] Bug fix (non-breaking change which fixes an issue)
[ ] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] This change requires a documentation update

How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration
Checklist:

[ ] I have performed a self-review of my code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] I have added meaningful description with JIRA/GitHub issue key(if applicable), for example HASSuiteDescribe("STONE-123456789 devfile source")
[ ] I have updated labels (if needed)

Odd the MVP scenario 1 failed because the the release was NOT expected to succeed but it did
status": {
                "completionTime": "2023-04-05T16:05:31Z",
                "conditions": [
                    {
                        "lastTransitionTime": "2023-04-05T16:05:31Z",
                        "message": "",
                        "reason": "Succeeded",
                        "status": "True",
                        "type": "Succeeded"
                    }
                ],
                "releasePipelineRun": "mvp-demo-managed-namespace/release-pipelinerun-m7jhl",
                "releaseStrategy": "mvp-demo-managed-namespace/mvp-strategy",
                "startTime": "2023-04-05T16:03:43Z",
                "target": "mvp-demo-managed-namespace"
            }

I noticed in the original way we were configuring the policy with the following configuration
Configuration: &ecp.EnterpriseContractPolicyConfiguration{
				Collections: []string{"minimal"},
				Exclude:     []string{"cve"},
			},

But in the new way, the default spec looks to have the following spec
"configuration": {
                    "exclude": [
                        "step_image_registries"
                    ],
                    "include": [
                        "@minimal"
                    ]
                }

@cuipinghuo could that have caused this failure?

Odd the MVP scenario 1 failed because the the release was NOT expected to succeed but it did
status": {
                "completionTime": "2023-04-05T16:05:31Z",
                "conditions": [
                    {
                        "lastTransitionTime": "2023-04-05T16:05:31Z",
                        "message": "",
                        "reason": "Succeeded",
                        "status": "True",
                        "type": "Succeeded"
                    }
                ],
                "releasePipelineRun": "mvp-demo-managed-namespace/release-pipelinerun-m7jhl",
                "releaseStrategy": "mvp-demo-managed-namespace/mvp-strategy",
                "startTime": "2023-04-05T16:03:43Z",
                "target": "mvp-demo-managed-namespace"
            }

I noticed in the original way we were configuring the policy with the following configuration
Configuration: &ecp.EnterpriseContractPolicyConfiguration{
				Collections: []string{"minimal"},
				Exclude:     []string{"cve"},
			},

But in the new way, the default spec looks to have the following spec
"configuration": {
                    "exclude": [
                        "step_image_registries"
                    ],
                    "include": [
                        "@minimal"
                    ]
                }

@cuipinghuo could that have caused this failure?

Thanks @Dannyb48 , I believe this is the root cause.
I updated pr based on the comment and the test passed.

thanks for this PR @cuipinghuo
should we update this in release tests as well?
#1
#2
#3

/test redhat-appstudio-e2e

/test redhat-appstudio-e2e

/lgtm

/lgtm


Exception : 'Invalid value'

I would like to save some data, but i have this error :
Terminating app due to uncaught exception 'RLMException', reason: 'Invalid value 'Test iOS2' to initialize object of type 'ViaNumber': missing key 'name''

I have a Object Call with a primary key
class Call: Object {
    // MARK: - Variables
    dynamic var id = 0
    dynamic var callUuid = ""
    dynamic var date = Date()
    dynamic var type = ""
    dynamic var direction = ""
    dynamic var via: ViaNumber?

	// MARK: - Function
    func setWithJson(_ call: JSON) {
        self.id = call["id"].intValue
        self.callUuid = call["call_uuid"].stringValue
        self.date = Date().formattedDate(call["created_at"].stringValue)
        self.type = call["type"].stringValue
        self.direction = call["direction"].stringValue
        let viaNumber = ViaNumber()
        viaNumber.setWithJson(call["via"])
        self.via = viaNumber
    }

    override static func primaryKey() -> String? {
        return "id"
    }
}

My ViaNumber object :
class ViaNumber: Object {

    dynamic var number: String = ""
    dynamic var name: String = ""
    let call = LinkingObjects(fromType: Call.self, property: "via")

    // MARK: - Function
    func setWithJson(_ viaJson: JSON) {
	self.number = viaJson["number"].stringValue.removeSpecialCaracters()
        self.name = viaJson["name"].stringValue
    }

}

To save all my object :
class func saveCallInbox(_ callsJson: JSON) {
    DispatchQueue(label: "background").async {
        autoreleasepool {
            if let realm = Realm.getRealm() {
                for i in 0..<callsJson.count {
                    print("json: \(callsJson[i])")
                    let call = self.createCall(callsJson[i])
                    self.saveInDataBase(realm, call: call)
                }
                print(callsJson.endIndex)
            }
        }
    }
}

class func saveInDataBase(_ realm: Realm, call: Call) {
    do {
        try realm.write {
            realm.add(call, update: true)
        }
    } catch let error {
        let string = "error to save call with id: '\(call.id)' : '\(error)'"
        DataControllerManager.sharedInstance.setFatalError(string)
    }
}

class func createCall(_ callJson: JSON) -> Call {
    let call = Call()
    call.setWithJson(callJson)
    return call
}

and the json:
{
  "call_uuid" : "CA0af113abf54ded8250130a156cf2018f",
  "direction" : "inbound",
  "created_at" : "2017-03-30T13:48:13.000Z",
  "via" : {
    "name" : "Test iOS2",
    "number" : "13473180571"
  },
  "id" : 45778,
  "type" : "voicemail",
}

Do you have an idea ?
thanks

The error message indicates that a value of type ViaNumber is being initialized with a value of "Test iOS2", when it expects an object with name and number entries. This message likely originates from below a call to ViaNumber.init(value:) or Realm.create(_:value:). The backtrace of where the exception was raised should help you track down which call you're making that's passing in the unexpected data.

the exception was rasied here : RLMObjectBase.mn line 442
id RLMValidatedValueForProperty(id object, NSString *key, NSString *className) {
    @try {
        return [object valueForKey:key];
    }
    @catch (NSException *e) {
        if ([e.name isEqualToString:NSUndefinedKeyException]) {
            @throw RLMException(@"Invalid value '%@' to initialize object of type '%@': missing key '%@'",
                                object, className, key);
        }
        @throw;
    }
}

But, when I initialized ViaNumber, name = "" and Number = "". So I don't understand why

I just test this :
        let json = JSON(["number": "test", "name": "test"])
        let viaNumber = ViaNumber()
        viaNumber.setWithJson(json)
        let realm = Realm.getRealm()!
        do {
            try realm.write {
                realm.add(viaNumber)
            }
        } catch {

        }

he  works perfectly

it's the same ...

I try an other this week. I keep you in touch

@lowki93 any news since your last comment?

Let's reopen this if @lowki93 responds and this still needs our attention.

I'm sorry the time.
I juste rename Via to ViaNumber an it's work.
I don't know why


Set the border radius of highlight

I discovered the corners of code blocks look not correct currently.

That's because the border-radius of .highlight didn't set, so I fix it now.

Thank you for your making Minima better.
@jekyllbot: merge +fix


flake: Egress rule tests in Prow fail with Auth enabled (but not CircleCI)

I spotted this flake twice since yesterday. https://k8s-gubernator.appspot.com/build/istio-prow/pull/istio_istio/3016/istio-pilot-e2e/2125/
Egress rules fail with auth mode. I am not sure if its caused by infrastructure losing connectivity or if its some flake in the way we setup egress rules tests. Note that this is just the symptom. The root cause could be totally unrelated to the egress rules test, because the same test passes in CircleCI!
I0131 23:09:35.395] =================== Failed infrastructure tests! =====================
I0131 23:09:35.396] 75 errors occurred:
I0131 23:09:35.396]
I0131 23:09:35.396] * (auth infra) http-reachability run 0 failed all 90 attempts for HTTP request from a to a:8080
I0131 23:09:35.396] * (auth infra) http2-reachability run 0 failed all 90 attempts for GRPC request from b to b.istio-test-app-ppxfr:7070
I0131 23:09:35.396] * (auth infra) tcp-reachability run 0 failed all 90 attempts for TCP connection from t to b.istio-test-app-ppxfr:9090
I0131 23:09:35.397] * (auth infra) ingress run 0 failed all 90 attempts for Ingress request to {dst:a url:http://istio-ingress.istio-test-8g22v/.well_known/foo host:}
I0131 23:09:35.397] * (auth infra) egress-rules run 0 ensure traffic to httbin.org is prohibited when setting *.httbin.org attempt 0 failed Request from a to http://httpbin.org/headers at attempt 0: http://httpbin.org/headers is reachable from a (should be unreachable)
I0131 23:09:35.397] * (auth infra) egress-rules run 0 ensure traffic to httbin.org is prohibited when setting *.httbin.org attempt 1 failed Request from a to http://httpbin.org/headers at attempt 0: http://httpbin.org/headers is reachable from a (should be unreachable)
I0131 23:09:35.398] * (auth infra) egress-rules run 0 ensure traffic to httbin.org is prohibited when setting *.httbin.org attempt 2 failed Request from a to http://httpbin.org/headers at attempt 0: http://httpbin.org/headers is reachable from a (should be unreachable)
I0131 23:09:35.398] * (auth infra) egress-rules run 0 prohibit http external traffic to cnn.com by a tcp egress rule attempt 0 failed Request from a to https://cnn.com at attempt 0: https://cnn.com is reachable from a (should be unreachable)
I0131 23:09:35.398] * (auth infra) egress-rules run 0 prohibit http external traffic to cnn.com by a tcp egress rule attempt 1 failed Request from b to https://cnn.com at attempt 0: https://cnn.com is reachable from b (should be unreachable)
I0131 23:09:35.399] * (auth infra) egress-rules run 0 prohibit http external traffic to cnn.com by a tcp egress rule attempt 2 failed Request from b to https://cnn.com at attempt 0: https://cnn.com is reachable from b (should be unreachable)

Note that HTTP, HTTP2 and TCP reachability tests inside the mesh - from a to a, b to b, t to b failed. Note that all the egress tests use external sites like httpbin.org, google.com and wikipedia.org. They have higher latency than in-mesh tests. So whenever any timeouts/delays issues appear, the external tests will fail first. In my opinion, egress tests should become suspect only if all in-mesh tests pass.

I suggest we target a local endpoint thru the external service mechanism so that we are not sensitive to latencies.
Curl -H “Host: google.com” http://mylocalsvc.clustervip/ should test our current impl.

It won’t reliably test since the endpoint will be under istio control. We have to be vigilant to model all properties of external endpoints. As vadim says, this is a symptom of something larger. These tests pass in circleci for every PR multiple times.

We could add a non istio injected service?
This being said it is useful to understand the failure

I0213 12:37:03.425] * (auth infra) zipkin run 0 failed all 90 attempts for Ensure traces are picked up by Zipkin
I0213 12:37:03.425] * (auth infra) kubernetes-external-name-services run 0 failed all 90 attempts for HTTP connection from b to externalbin

still happening @andraxylia can you assign someone ?
https://k8s-gubernator.appspot.com/build/istio-prow/pull/istio_istio/3302/istio-pilot-e2e/2891/

Egress rules e2e disabled by https://github.com/istio/istio/pull/4092 so the issue is not relevant.


Reading a parquet with timestamp out of bounds in pandas

Hi,
I'm using pandas to read a parquet file which unfortunately has some timestamps in the year 2500. Of course this causes problem Casting from timestamp[us, tz=UTC] to timestamp[ns] would result in out of bounds timestamp:<PHONE_NUMBER>0000000.
There should be an option in read_table with safe = False which would coerce these timestamps to be NaT which would be the ideal solution but unfortunately there is nothing in the official documentation.
Right now I'm blocked as I cannot modify the original parquet file (as I cannot open it).
Is there any workaround to somehow filter out these values before reading it into pandas?

Hi @guidocioni,
You could probably read the data into an arrow table and use the timestamp_as_object object when calling to_pandas then do the filtering yourself.
In general, we prefer to answer questions on the user@ or if appropriate dev@ mailing list to answer questions.  So I'm going to resolve this issue for now.


autoGuessEncoding improvements

At the moment, Code is not very good with automatic guessing the encoding, and work on projects with non-utf8 encodings.
There are 2 proposals that could improve the current situation:

Cache the previously selected encodings for files in the format { filepath: encoding }. You can set a limit on the N most recently opened files, for example. This will give an increase in performance when opening recent files and will save you from incorrect recognition of the encoding. This feature can be implemented in the context of the project, workspace or globally.

Provide the possibility to specify used encodings in the project settings. Suppose we are working on a project that has legacy codebase in windows1251, and the rest of the files are in utf8. We can specify something like { projectEncodings: ['windows1251', 'utf8'] }, and if the file's encoding is auto-detected, the editor will notify you, that the encoding is most likely not detected correctly. This option is perfectly matched with the first paragraph.

Any news on this feature? Maybe someone can propose an implementation ideas, and I'll do a pull request?

@irudoy encodings when set on an opened tab now survive restarts and we added support to configure encoding per file extension. Is there something missing?

@bpasero, imagine that you are working on a project that has more than 32,000 files. More than half of them are files in the cp1251 encoding, others in the utf8. Every day at work, you open a total of about 100 files, and the encoding is very often detected incorrectly. In this case, you need to always make sure that it has been detected correctly, otherwise, you must set it manually. But if the editor could remember which encoding was set for a certain file, even after closing tab, it would be great and would save developers from many countries a lot of nerves and time. Moreover, the editor already knows how to remember the last position of the cursor, so why not add the encoding as well?

I am merging this into https://github.com/Microsoft/vscode/issues/23570 and https://github.com/Microsoft/vscode/issues/36951


change to startswith matching of entries

this implies that the database is clean and no key can be the prefix of another key, because they would match now.

That is a very strong assumption. It could lead to some unexpected things, e.g. when someone adds a new entry for which a prefix already exists (Foo2020 exists, user adds Foo2020new). In this case, adding the entry fails with the error that it already exists (which is misleading). For existing entries with prefixes, the search would find all entries, but only the first one in the database can be used. Using any of the other entries fails silently.

my database doesn't have entries with prefixes atm

Other databases do have prefixes, and this would break the tool for these databases. This option should at least be optional.

The introduction of a policy in 235f6add3d21257d17514f4956f077f2fe6cdfcc makes this pull request obsolete.


Standardize license across source files

Some of the source files were still mentioning the BSD license. I changed them to CC-BY-4.0 and also made the year consistent as 2013 (some files were 2015).

Thanks.


Should MoveLooseDeclarationsIntoTypesTransformation handle enums translated as loose?

Followup from https://github.com/InfectedLibraries/Biohazrd/issues/120
It seems like MoveLooseDeclarationsIntoTypesTransformation should be handling this scenario.

I don't remember why I hesitated to do this, but I don't see why it shouldn't.
The only reason I could think of not to is I eventually want to remove TranslateAsLooseConstants entirely. (https://github.com/InfectedLibraries/Biohazrd/issues/173) However we can just revert the changes if/when that happens.


'directives' not supposed to be here.

Probably left over from some other code snippet.

Thanks. It was a leftover from the RC version.


Change Confidential Compute reference

As part of the Databricks cluster deployment, a Confidential Compute SKU is given in the examples. To avoid an overload of this SKU, we should refer to a more generic SKU.
DoD

Modify the SKU used on the cluster json definition
Modify read me to clearly explain which combination of SKUs needs to be checked as a pre-requirement (SKU available in the subscription/region and available on the databricks service)
Add validation to the databricks cluster deployment to verify the capacity exists in the region before attempting to deploy.

Would it be possible to get the cluster types from the API and pass to shell script?
https://docs.databricks.com/api/workspace/clusters/listnodetypes


Can we train model with some images of our own

Dear sir, I am working on face recognition, need to train (incrementally train) already trained model with images of my classmates. Is this some how possible and can you guide me to some relevant link?

Check this issue https://github.com/davisking/dlib/issues/922. I am guessing it is not possible to train the model with trained model as starting point as the batch norm layer is removed saved trained model.
Also as Davis suggests, it is not a good idea to fine tune.


WIP: dbg DNS over TCP NA fields

Description

Dependencies

n/a
Checklist
If you are not familiar with our processes or don't know what to answer in the list below, let us know in a comment: the maintainers will take care of that.

[ ] Will this change affect NetObserv / Network Observability operator? If not, you can ignore the rest of this checklist.
[ ] Is this PR backed with a JIRA ticket? If so, make sure it is written as a title prefix (in general, PRs affecting the NetObserv/Network Observability product should be backed with a JIRA ticket - especially if they bring user facing changes).
[ ] Does this PR require product documentation?

[ ] If so, make sure the JIRA epic is labelled with "documentation" and provides a description relevant for doc writers, such as use cases or scenarios. Any required step to activate or configure the feature should be documented there, such as new CRD knobs.

[ ] Does this PR require a product release notes entry?

[ ] If so, fill in "Release Note Text" in the JIRA.

[ ] Is there anything else the QE team should know before testing? E.g: configuration changes, environment setup, etc.

[ ] If so, make sure it is described in the JIRA ticket.

QE requirements (check 1 from the list):

[ ] Standard QE validation, with pre-merge tests unless stated otherwise.
[ ] Regression tests only (e.g. refactoring with no user-facing change).
[ ] No QE (e.g. trivial change with high reviewer's confidence, or per agreement with the QE team).

when we get N/A bpf_skb_load_bytes() return an error
Not working
==========
"dns_record": {
                        "id": 0,
                        "flags": 0,
                        "latency": 0,
                        "errno": 14 <<<<<<<<<<<<<<< "EFAULT"
                    },

working
=======
dns_record": {
                        "id": 31706,
                        "flags": 34176,
                        "latency": 228919,
                        "errno": 0
                    },

/ok-to-test

/ok-to-test

/ok-to-test

/ok-to-test

/ok-to-test

/ok-to-test

@msherif1234 are there error codes we should expect ?
https://elixir.bootlin.com/linux/v4.7/source/include/uapi/asm-generic/errno-base.h#L10

@msherif1234 are these error codes we should expect ? https://elixir.bootlin.com/linux/v4.7/source/include/uapi/asm-generic/errno-base.h#L10

Correct

/ok-to-test

/ok-to-test

/ok-to-test

/label qe-approved

/approve