Clean up metadata validation

Validates correctly (looks for list in access section and dicts in transport and representation)
Finds all errors in a metadata block rather than stopping at the first one, producing better reporting
Pushes error details to CSV format output from harvester
Finds errors in multiple metadata blocks rather than stopping at the first failed block in a file

Also added --file argument to oe_check_metadata so we can run this without needing http URLs, either --file or --url must be specified

@tomoinn I used this version of the library to push datasets to our preprod CKAN instance but I'm getting a too well known error, even when ran locally:

raise ConnectionError(err, request=request)
requests.exceptions.ConnectionError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))

I don't see this problem when running the code of the main branch. Any ideas about what's causing it?

@KKulma is that causing it to actually fail, or just return an error for a data set?

It fails the push to CKAN. This means that the actual metadata validation went ok and it tries to push something but like before, it fails when trying to push a third dataset to Passiv UK org:
INFO:ib1.openenergy.support.ckan:creating new organisation in CKAN, id=13562, title=Passiv UK
INFO:ib1.openenergy.support.ckan:creating data package id=oe-13562-69146804-d8f0-11eb-b8bc-0242ac130003 in CKAN
INFO:ib1.openenergy.support.ckan:creating data package id=oe-13562-c0c06274-d8f0-11eb-b8bc-0242ac130003 in CKAN
INFO:ib1.openenergy.support.ckan:creating data package id=oe-13562-69146a34-d8f0-11eb-b8bc-0242ac130003 in CKAN
Traceback (most recent call last):
  File "/Users/katarzynakulma/MEGAsync/projects/open-energy/open-energy-python-infrastructure/venv/lib/python3.8/site-packages/urllib3-1.26.6-py3.8.egg/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/Users/katarzynakulma/MEGAsync/projects/open-energy/open-energy-python-infrastructure/venv/lib/python3.8/site-packages/urllib3-1.26.6-py3.8.egg/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/Users/katarzynakulma/MEGAsync/projects/open-energy/open-energy-python-infrastructure/venv/lib/python3.8/site-packages/urllib3-1.26.6-py3.8.egg/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/http/client.py", line 1322, in getresponse
    response.begin()
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/http/client.py", line 303, in begin
    version, status, reason = self._read_status()
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/http/client.py", line 272, in _read_status
    raise RemoteDisconnected("Remote end closed connection without"
http.client.RemoteDisconnected: Remote end closed connection without response

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Users/katarzynakulma/MEGAsync/projects/open-energy/open-energy-python-infrastructure/venv/lib/python3.8/site-packages/requests-2.26.0-py3.8.egg/requests/adapters.py", line 439, in send
    resp = conn.urlopen(
  File "/Users/katarzynakulma/MEGAsync/projects/open-energy/open-energy-python-infrastructure/venv/lib/python3.8/site-packages/urllib3-1.26.6-py3.8.egg/urllib3/connectionpool.py", line 755, in urlopen
    retries = retries.increment(
  File "/Users/katarzynakulma/MEGAsync/projects/open-energy/open-energy-python-infrastructure/venv/lib/python3.8/site-packages/urllib3-1.26.6-py3.8.egg/urllib3/util/retry.py", line 532, in increment
    raise six.reraise(type(error), error, _stacktrace)
  File "/Users/katarzynakulma/MEGAsync/projects/open-energy/open-energy-python-infrastructure/venv/lib/python3.8/site-packages/urllib3-1.26.6-py3.8.egg/urllib3/packages/six.py", line 769, in reraise
    raise value.with_traceback(tb)
  File "/Users/katarzynakulma/MEGAsync/projects/open-energy/open-energy-python-infrastructure/venv/lib/python3.8/site-packages/urllib3-1.26.6-py3.8.egg/urllib3/connectionpool.py", line 699, in urlopen
    httplib_response = self._make_request(
  File "/Users/katarzynakulma/MEGAsync/projects/open-energy/open-energy-python-infrastructure/venv/lib/python3.8/site-packages/urllib3-1.26.6-py3.8.egg/urllib3/connectionpool.py", line 445, in _make_request
    six.raise_from(e, None)
  File "<string>", line 3, in raise_from
  File "/Users/katarzynakulma/MEGAsync/projects/open-energy/open-energy-python-infrastructure/venv/lib/python3.8/site-packages/urllib3-1.26.6-py3.8.egg/urllib3/connectionpool.py", line 440, in _make_request
    httplib_response = conn.getresponse()
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/http/client.py", line 1322, in getresponse
    response.begin()
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/http/client.py", line 303, in begin
    version, status, reason = self._read_status()
  File "/Library/Frameworks/Python.framework/Versions/3.8/lib/python3.8/http/client.py", line 272, in _read_status
    raise RemoteDisconnected("Remote end closed connection without"
urllib3.exceptions.ProtocolError: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response'))

Not sure, sounds like CKAN not liking the rate maybe?

Not sure, sounds like CKAN not liking the rate maybe?

When I look in the oe3-preprod/var/log/eb-docker/containers/eb-current-app/stdouterr.log log in AWS CloudWatch I see a call to package_create at 10:40:02 (@KKulma, I assume this is when you ran the harvester?), immediately followed by two call to resource_create and nothing that looks like an error, disconnection or rate limiting.
I don't know Python's requests library well, but I wonder if we can get it to tell us more about what happens at a lower level (HTTP and TCP) when it talks to CKAN.  Also it would be very useful to prefix each log line with a timestamp so we don't have to guess when an event happened.  Would it be easy to modify the script to do this?

You can turn on debug logging using the command line switches, that will show all the HTTP transactions made by requests and probably those made by the underlying HTTP library. The calls to CKAN aren't made through requests though, so I'm not sure whether they'll be logged.

That code is not using requests.

It's being done through a CKAN library, and I'm fairly sure it's just using httplib or whatever the underlying implementation is

That code is not using requests.

That code uses ckanapi which uses requests under the hood.

I've pushed a change to enable httpclient logging and to add timestamps, if you run the harvester with DEBUG log level you should now see a lot of logging, hopefully it'll help

That code is not using requests.

That code uses ckanapi which uses requests under the hood.

The README states that

As of ckanapi 4.0 RemoteCKAN will keep your HTTP connection open using a requests session.
For long-running scripts make sure to close your connections by using RemoteCKAN as a context manager

is it something we can incorporate, @tomoinn ?

Yes, was just about to say that. We definitely can, I'll make the change.

Trivial change, it could well be the problem though if the connections weren't being cleaned up within the CKAN remote API itself

OK, that did the trick, thanks @tomoinn ! 🥇
FYI, here's the log from CKAN push, it looks like at one point we're trying to push a dataset based on the incorrectly structured metadata file, so this could be something that the validation stepped might have missed:
2021-07-29 14:29:23 INFO     organisation id=13562 already exists in CKAN
2021-07-29 14:29:23 INFO     data package id=oe-13562-69146804-d8f0-11eb-b8bc-0242ac130003 already exists in CKAN, updating
2021-07-29 14:29:25 INFO     data package id=oe-13562-c0c06274-d8f0-11eb-b8bc-0242ac130003 already exists in CKAN, updating
2021-07-29 14:29:26 INFO     creating data package id=oe-13562-69146a34-d8f0-11eb-b8bc-0242ac130003 in CKAN
2021-07-29 14:29:27 INFO     creating data package id=oe-13562-69146b1a-d8f0-11eb-b8bc-0242ac130003 in CKAN
2021-07-29 14:29:28 INFO     creating data package id=oe-13562-69146d7c-d8f0-11eb-b8bc-0242ac130003 in CKAN
2021-07-29 14:29:30 INFO     creating data package id=oe-13562-69146e44-d8f0-11eb-b8bc-0242ac130003 in CKAN
2021-07-29 14:29:31 INFO     creating data package id=oe-13562-69146f02-d8f0-11eb-b8bc-0242ac130003 in CKAN
2021-07-29 14:29:33 INFO     creating data package id=oe-13562-69146fb6-d8f0-11eb-b8bc-0242ac130003 in CKAN
2021-07-29 14:29:34 INFO     creating new organisation in CKAN, id=sse, title=SSE
2021-07-29 14:29:34 INFO     creating data package id=oe-sse-mydata in CKAN
2021-07-29 14:29:36 INFO     creating new organisation in CKAN, id=national_grid, title=National Grid
2021-07-29 14:29:36 INFO     creating data package id=oe-national_grid-ngetsubscapacity in CKAN
2021-07-29 14:29:37 INFO     creating data package id=oe-national_grid-ngetpreapps in CKAN
2021-07-29 14:29:38 INFO     creating new organisation in CKAN, id=open_energy, title=Open Energy
2021-07-29 14:29:39 INFO     creating data package id=oe-open_energy-bis-rt-electricity-co2 in CKAN
2021-07-29 14:29:40 INFO     creating new organisation in CKAN, id=bham, title=University of Birmingham
2021-07-29 14:29:40 INFO     creating data package id=oe-bham-gb-espeni-uob in CKAN
2021-07-29 14:29:41 INFO     creating new organisation in CKAN, id=urban-tide, title=Urban Tide
2021-07-29 14:29:42 INFO     creating data package id=oe-urban-tide-livinglab in CKAN
org_id,org_name,success,auth_server_id,metadata_location,error,ckan_dataset_name,ckan_dataset_title
13562,Passiv UK,False,bef7db7e-1466-4f93-a4a3-e118e2b15a37,https://www.passivsystems.com/Logo,unable to retrieve metadata file : 404 Client Error: Not Found for url: https://passivuk.com/Logo,,
13562,Passiv UK,False,677e28b4-c1da-4f43-838a-49be3c362aaa,https://www.passivsystems.com/logo,unable to retrieve metadata file : 404 Client Error: Not Found for url: https://passivuk.com/logo,,
13562,Passiv UK,True,35b66fb0-4c7d-4df8-9c88-5e67cb07bbda,https://dmz6.passivonline.com/open-energy/metadata.yaml,,oe-13562-69146804-d8f0-11eb-b8bc-0242ac130003,WPD Substation Details
13562,Passiv UK,True,35b66fb0-4c7d-4df8-9c88-5e67cb07bbda,https://dmz6.passivonline.com/open-energy/metadata.yaml,,oe-13562-c0c06274-d8f0-11eb-b8bc-0242ac130003,Aggregated Substation Energy Per Period
13562,Passiv UK,True,5debe1a1-afaa-4d1a-b256-3e3f52f9a3a2,https://dmz6.passivonline.com/open-energy/bridgend-laep-metadata.yaml,,oe-13562-69146a34-d8f0-11eb-b8bc-0242ac130003,Bridgend LAEP Building Connections
13562,Passiv UK,True,5debe1a1-afaa-4d1a-b256-3e3f52f9a3a2,https://dmz6.passivonline.com/open-energy/bridgend-laep-metadata.yaml,,oe-13562-69146b1a-d8f0-11eb-b8bc-0242ac130003,Bridgend LAEP Feeder Capacities
13562,Passiv UK,True,5debe1a1-afaa-4d1a-b256-3e3f52f9a3a2,https://dmz6.passivonline.com/open-energy/bridgend-laep-metadata.yaml,,oe-13562-69146d7c-d8f0-11eb-b8bc-0242ac130003,Bridgend LAEP Feeder Capacities
13562,Passiv UK,True,5debe1a1-afaa-4d1a-b256-3e3f52f9a3a2,https://dmz6.passivonline.com/open-energy/bridgend-laep-metadata.yaml,,oe-13562-69146e44-d8f0-11eb-b8bc-0242ac130003,Bridgend LAEP Load Data
13562,Passiv UK,True,5debe1a1-afaa-4d1a-b256-3e3f52f9a3a2,https://dmz6.passivonline.com/open-energy/bridgend-laep-metadata.yaml,,oe-13562-69146f02-d8f0-11eb-b8bc-0242ac130003,Bridgend LAEP New Heat Demands
13562,Passiv UK,True,5debe1a1-afaa-4d1a-b256-3e3f52f9a3a2,https://dmz6.passivonline.com/open-energy/bridgend-laep-metadata.yaml,,oe-13562-69146fb6-d8f0-11eb-b8bc-0242ac130003,Bridgend LAEP Pathways
dt_squared,DT Squared,False,1d61c6f4-572e-40d6-b6eb-e8f28716a497,https://www.dropbox.com/s/1en5qirvlhikips/IB1%20DTSQUARED%20TEST%20METADATA%20FILE%20v2.yml?dl=0,"unable to parse metadata file as either JSON or YAML : mapping values are not allowed here
  in ""<byte string>"", line 19, column 28:
                * { font-weight: inherit; }
                               ^",,
8,A Demo Provider,False,7a1e7ea9-2691-442d-b4fb-52b7c2d369f9,https://www.demo.org.uk/logo,"unable to retrieve metadata file : HTTPSConnectionPool(host='www.demo.org.uk', port=443): Max retries exceeded with url: /logo (Caused by SSLError(SSLCertVerificationError(""hostname 'www.demo.org.uk' doesn't match either of 'domainlore.co.uk', 'domainlore.uk'"")))",,
sse,SSE,True,b172fd1b-ba21-49d1-a835-8e41257e5766,https://rg-services-dev-uksouth-001-ecr-poc-aps-001.azurewebsites.net/api/GetEmbeddedCapacityRegisterCsvDataSpecification,,oe-sse-mydata,SSEN Embedded Capacity Register data set
national_grid,National Grid,True,a83a086a-519d-4c3d-b0c0-b8a221c1a61c,http://openenergy.ngdigitalda.co.uk/NGET/substation-capacity/NGET-Substation-Capacity.yml,,oe-national_grid-ngetsubscapacity,NGET Substation Capacity
national_grid,National Grid,True,602e8f7e-9d37-4014-80cc-20a862cc7ef8,http://openenergy.ngdigitalda.co.uk/NGET/pre-applications/NGET-Pre-Applications.yml,,oe-national_grid-ngetpreapps,NGET Pre-applications by Site
open_energy,Open Energy,True,3fe51740-4099-41a1-b0bf-0db0f6025c30,https://raw.githubusercontent.com/icebreakerone/open-energy-metadata-demo/main/metadata_files/bis-rt-electricity-co2.json,,oe-open_energy-bis-rt-electricity-co2,Real-time electricity (CO2) data for BIS headquarters building
open_energy,Open Energy,False,b5a325a9-2d58-4403-9c89-bebbc1c0f3ad,https://raw.githubusercontent.com/icebreakerone/open-energy-metadata-demo/main/metadata_files/bis-rt-electricity-kwh.yaml,"invalid metadata description : Unable to parse metadata item 1 : access does not contain nested list content, value was ""None""",,
3a97a036-b0ab-44e8-8da6-a5d1f890bb88,Raidiam Energy Provision,False,ede89a79-04c0-471c-94b7-a45fdeed3bbd,https://Authserver.com/,"unable to retrieve metadata file : HTTPSConnectionPool(host='authserver.com', port=443): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f88c2122940>: Failed to establish a new connection: [Errno 61] Connection refused'))",,
bham,University of Birmingham,True,233fcd53-4380-4d5c-b9d9-7aa6ba6ce66d,https://raw.githubusercontent.com/iagw/metadata/master/espeni.json,,oe-bham-gb-espeni-uob,Electrical half hourly raw and cleaned datasets for Great Britain from 2009-11-05
urban-tide,Urban Tide,True,848a0653-db5c-4079-bacb-66ebae01acc6,https://usmart-static.s3.eu-west-1.amazonaws.com/livinglab18-19-home-model.json,,oe-urban-tide-livinglab,Living Lab 18-19 Home Model - Eden 1-5
project-leo,Project LEO,False,aba39b30-4ce9-4d3e-a755-d4228008a13d,https://drive.google.com/file/d/1_ooW6sKIwv1nXq5IJeaFvFJnSskDoynH/view?usp=sharing,"unable to parse metadata file as either JSON or YAML : mapping values are not allowed here
  in ""<byte string>"", line 1, column 6896:
     ... uJQ"">window.viewerData = {config: {'id': '1_ooW6sKIwv1nXq5IJeaFv ...
                                         ^",,
electralink,ElectraLink,False,45eeb946-18c9-4ffa-b829-a66679ecdf33,https://ib1-test-data.s3.eu-west-1.amazonaws.com/EL_MONTHLY_COS_STATS.yaml,"invalid metadata description : Unable to parse metadata item 0 : transport does not contain nested dict content, value was ""None""; representation does not contain nested dict content, value was ""None""; unknown top level key ""http"" in metadata file; unknown top level key ""mime"" in metadata file; unknown top level key ""csvw"" in metadata file",,
electralink,ElectraLink,False,0c237eef-1813-4ba9-8076-72fed8691914,https://ib1-test-data.s3.eu-west-1.amazonaws.com/EL_MONTHLY_COS_STATS_json.yaml,"invalid metadata description : Unable to parse metadata item 0 : transport does not contain nested dict content, value was ""None""; unknown top level key ""http"" in metadata file",,


Functionality?

Greetings. I am scratching my head with this.
'gdrive list' shows maybe a dozen of my files and one directory.
It bears no resemblance to my actual Google Drive account with many directories and files.
Even if it did show them, I see now way to simply "gdrive download -r *" and copy my files to my machine.
Can someone please explain exactly is going on here, and how do we use this program as a "client for Google Drive"?

Did you check out the pages of Usage docs in the README?

Greetings. I am scratching my head with this.
'gdrive list' shows maybe a dozen of my files and one directory.
It bears no resemblance to my actual Google Drive account with many directories and files.
Even if it did show them, I see now way to simply "gdrive download -r *" and copy my files to my machine.
Can someone please explain exactly is going on here, and how do we use this program as a "client for Google Drive"?

Since Google Drive's file structure is different than a desktop operating system, each folder/file in Google Drive have an ID. So to point a file/folder with  'gdrive list' command you can see the each ID.
Then for example you can sync a local folder just like below:
gdrive sync upload C:\Users\Anyfolder\ExampleSyncFolder 1fdsdfsEXAMPLEY7ji87sd8s78ds7s8d4s4ds5SAMple
1fdsdfsEXAMPLEY7ji87sd8s78ds7s8d4s4ds5SAMple -> this part is a sample ID for a folder that you get via "gdrive list".


Mapper: how to define object serialization/mapping code in a separate package?

I'm trying to separate object model case classes and their DynamoDb serialization-mapping code by having them in different packages (to provide different persistence mechanism in future). For instance, I'd like to have my case class ApiAccessToken in package model and corresponding mapping code in object DdbApiAccessToken in package model.dynamodb.
I defined all attributes along with an implicit object for toAttributeMap/fromAttributeMap methods in DdbApiAccessToken. It compiles fine, but when I try to use mapper.loadByKey, the compiler complains that it can't find a magnet:
Error:(49, 54) type mismatch;
 found   : String
 required: mapper.LoadByKeyMagnet[model.ApiAccessToken]
      data <- mapper.loadByKey[ApiAccessToken](dummy.token)
                                                     ^

Is it possible? Am I missing something completely?
Thanks,

Hi @alboko, my first guess would be that it’s an issue of implicit scope.
The error message is unfortunately not very helpful to you (a major downside of the magnet pattern), but I suspect it can’t resolve the overloading in the magnet pattern because it can’t find the right implicit:
https://github.com/dwhjames/aws-wrap/blob/087cbdf48909b1584c42b043a5ab9b2b3e846379/src/main/scala/dynamodb/mapper.scala#L478-L498
If the necessary implicits are all in model.dynamodb.DdbApiAccessToken, I assume you have an
import model.dynamodb.DdbApiAccessToken._

or similar?
And also
import com.github.dwhjames.awswrap.dynamodb._

?

Hi Daniel,
Thanks for the answer. Yes, it’s definitely about the implicit scope. I made sure to import "DdbApiAccessToken._”. Didn’t help. Everything works if I move it to the same package.
Anyway, I ended up refactoring model classes to pure traits, introducing correspond Dbb… case classes in “model.dynamodb” package (extended from model traits) and moving mapping/serialization into their companion objects. Seems to work. And it’s probably cleaner as well.
Thanks again for the nice library.
Alex

On Apr 21, 2015, at 9:54 AM, Daniel James<EMAIL_ADDRESS>wrote:
Hi @alboko https://github.com/alboko, my first guess would be that it’s an issue of implicit scope.
The error message is unfortunately not very helpful to you (a major downside of the magnet pattern), but I suspect it can’t resolve the overloading in the magnet pattern because it can’t find the right implicit:
https://github.com/dwhjames/aws-wrap/blob/087cbdf48909b1584c42b043a5ab9b2b3e846379/src/main/scala/dynamodb/mapper.scala#L478-L498 https://github.com/dwhjames/aws-wrap/blob/087cbdf48909b1584c42b043a5ab9b2b3e846379/src/main/scala/dynamodb/mapper.scala#L478-L498
If the necessary implicits are all in model.dynamodb.DdbApiAccessToken, I assume you have an
import model.dynamodb.DdbApiAccessToken._
or similar?
And also
import com.github.dwhjames.awswrap.dynamodb._
?
—
Reply to this email directly or view it on GitHub https://github.com/dwhjames/aws-wrap/issues/33#issuecomment-94800509.

Hi Alex,
I recently removed the use of view bound syntax (deprecated)
https://github.com/dwhjames/aws-wrap/commit/53eb5522415c208f371fcfeb0ff7aa853dd479db
I assumed that would be of no consequence.
If you did have your implicits in scope, then maybe it was an issue with finding the implicit views to AttributeValue.
https://github.com/dwhjames/aws-wrap/blob/master/src/main/scala/dynamodb/package.scala
In any case, I’m glad you got it to work. Debugging implicits is not fun!
Dan

Dan,

I recently removed the use of view bound syntax (deprecated)
53eb552 https://github.com/dwhjames/aws-wrap/commit/53eb5522415c208f371fcfeb0ff7aa853dd479db
I assumed that would be of no consequence.

Thanks, I’ll keep it in mind

If you did have your implicits in scope, then maybe it was an issue with finding the implicit views to AttributeValue.
https://github.com/dwhjames/aws-wrap/blob/master/src/main/scala/dynamodb/package.scala https://github.com/dwhjames/aws-wrap/blob/master/src/main/scala/dynamodb/package.scalaRight, that’s was probably the issue. I was not able to figure it out.

One more question regarding AttributeValue - is there an implicit conversion to/for Options? I ended up with quite ugly code like:
case class DdbApiCredentials(
accountId: Long,
accountTypeCode: String, // Enumeration.name
accountName: Option[String],
accountStatusCode: String,  // Enumeration.name
clientSecret: String,
clientPassword: String,
accessTokenId: Option[String]
) extends ApiCredentials
object DdbApiCredentials {
override def toAttributeMap(item: DdbApiCredentials): Map[String, AttributeValue] = {
val amap = scala.collection.mutable.HashMap[String, AttributeValue](
Attributes.accountId          -> item.accountId,
Attributes.accountTypeCode    -> item.accountTypeCode,
Attributes.accountStatusCode  -> item.accountStatusCode,
Attributes.clientSecret       -> item.clientSecret,
Attributes.clientPassword     -> item.clientPassword
)
// optional fields
item.accountName foreach (v => amap += (Attributes.accountName -> v))
item.accessTokenId foreach (v => amap += (Attributes.accessTokenId -> v))
amap.toMap  // back to immutable

}
override def fromAttributeMap(amap: collection.mutable.Map[String, AttributeValue]) = new DdbApiCredentials(
accountId         = amap(Attributes.accountId),
accountTypeCode   = amap(Attributes.accountTypeCode),
accountName       = amap.get(Attributes.accountName).map(.getS),
accountStatusCode = amap(Attributes.accountStatusCode),
clientSecret      = amap(Attributes.clientSecret),
clientPassword    = amap(Attributes.clientPassword),
accessTokenId     = amap.get(Attributes.accessTokenId).map(.getS)
)
}
I suspect I’ll have to add my own implicit conversions ;)
Thanks,
Alex

I would write that with a builder.
val builder = Map.newBuilder[String, AttributeValue]
builder += Attributes.accountId -> item.accountId
…
builder.result()

Dan,
Thanks, that's a better approach. What about fromAttributes:
accountName = amap.get(Attributes.accountName).map(_.getS),
Is it a right way to go?

On Apr 21, 2015, at 11:45 AM, Daniel James<EMAIL_ADDRESS>wrote:
I would write that with a builder.
val builder = Map.newBuilder[String, AttributeValue]
builder += Attributes.accountId -> item.accountId
…
builder.result()
—
Reply to this email directly or view it on GitHub https://github.com/dwhjames/aws-wrap/issues/33#issuecomment-94845561.

Yeah, I imagine I’ve done something like that previously.


Release source tar.gz with wheel on pypi

Hi,
We can't install 0.15 versions on some project because only wheel version is available on pypi.
Pip disable wheels when using some build options
example requirements.txt :
GDAL==2.2.4 --global-option=build_ext --global-option="-I/usr/include/gdal/"
djangorestframework-gis==0.15

output :
pip install -r requirements.txt
/opt/geotrek-admin/env/lib/python3.6/site-packages/pip/req/req_file.py:150: UserWarning: Disabling all use of wheels due to the use of --build-options / --global-options / --install-options.
  cmdoptions.check_install_build_global(options, opts)
Collecting ********
  Downloading *****
Collecting djangorestframework-gis==0.15 (from -r requirements.txt (line 37))
  Could not find a version that satisfies the requirement djangorestframework-gis==0.15 (from -r requirements.txt (line 37)) (from versions: 0.1, 0.2, 0.3, 0.4, 0.5, 0.6, 0.7, 0.8, 0.8.1, 0.8.2, 0.9, 0.9.1, 0.9.2, 0.9.3, 0.9.4, 0.9.5, 0.9.6, 0.10, 0.10.1, 0.11, 0.11.1, 0.11.2, 0.12, 0.13, 0.14)
No matching distribution found for djangorestframework-gis==0.15 (from -r requirements.txt (line 37))

Can you upload tar.gz version on pypi as 0.14 ? thank you
https://pypi.org/project/djangorestframework-gis/0.14/#files
https://pypi.org/project/djangorestframework-gis/0.15/#files

Sorry for that. It's fixed now: https://pypi.org/project/djangorestframework-gis/#files


Finish Typed Response Objects

We have the framework for typed response Objects (Models) and it will be filled piece by piece.
At some point (which is this ticket) we have to go through everything and complete the typing. Doesn't help and splitting it into pieces will just confuse users.
When done, we'll do performance optimizations

obsolete


Don't wrap XMLStreamException into IOException

We have a lot of places where XMLStreamException is wrapped into IOException, but is does not seem right: XMLStreamException is

the base exception for unexpected processing errors

and does not have anything to do with I/O operations failure. Let's fix it by maybe introducing another exception for all possible error while working with xml files.

Job gh:artipie/rpm-adapter#323 is not assigned, can't get performer


mcl_3dl_msgs: 0.1.2-0 in 'indigo/distribution.yaml' [bloom]

Increasing version of package(s) in repository mcl_3dl_msgs to 0.1.2-0:

upstream repository: https://github.com/at-wat/mcl_3dl_msgs.git
release repository: https://github.com/at-wat/mcl_3dl_msgs-release.git
distro file: indigo/distribution.yaml
bloom version: 0.6.4
previous version for package: null

mcl_3dl_msgs
* Fix package dependency (https://github.com/at-wat/mcl_3dl_msgs/issues/2)
* Build messages and services
* Initial drop from mcl_3dl package
* Support variable particle size (https://github.com/at-wat/mcl_3dl/issues/78)

    * Support variable particle size.
    * Add service to change particle size.
    * Add test for resizeParticle.

* Add localization status output (https://github.com/at-wat/mcl_3dl/issues/120)
* Contributors: Atsushi Watanabe

closing due to an upstream problem


Can't install gonb undefined: exec

My setup is clean go install using go env manager goenv but the same issue occurred when doing clean install without go version manager.
>go version
go version go1.21.1 darwin/arm64
When running
>go install github.com/janpfeifer/gonb@latest
I get this error:
# github.com/janpfeifer/gonb/internal/goexec
go/1.21.1/pkg/mod/github.com/janpfeifer/gonb@v0.9.1/internal/goexec/cwd_others.go:18:9: undefined: exec
go/1.21.1/pkg/mod/github.com/janpfeifer/gonb@v0.9.1/internal/goexec/cwd_others.go:18:36: undefined: strconv
go/1.21.1/pkg/mod/github.com/janpfeifer/gonb@v0.9.1/internal/goexec/cwd_others.go:19:2: undefined: klog
go/1.21.1/pkg/mod/github.com/janpfeifer/gonb@v0.9.1/internal/goexec/cwd_others.go:20:15: undefined: os
go/1.21.1/pkg/mod/github.com/janpfeifer/gonb@v0.9.1/internal/goexec/cwd_others.go:25:5: undefined: klog
go/1.21.1/pkg/mod/github.com/janpfeifer/gonb@v0.9.1/internal/goexec/cwd_others.go:26:3: undefined: klog
go/1.21.1/pkg/mod/github.com/janpfeifer/gonb@v0.9.1/internal/goexec/cwd_others.go:29:11: undefined: strings
go/1.21.1/pkg/mod/github.com/janpfeifer/gonb@v0.9.1/internal/goexec/cwd_others.go:31:6: undefined: strings
go/1.21.1/pkg/mod/github.com/janpfeifer/gonb@v0.9.1/internal/goexec/cwd_others.go:32:11: undefined: strings

Additional info:
>echo $GOPATH
/Users/XXX/go/1.21.1
>echo $GOROOT
/Users/XXX/.goenv/versions/1.21.1

Not sure if some dependency is missing or if my setup has some issues.

I'm sorry to hear about the issues @Qwoter, and thanks for the report.
But it's a fresh release, there may be an issue. I'll  try to reproduce it tomorrow morning and report back.

I think I found the issue. The offending package has a different implementation for non-linux builds, and I don't have a way to test it (both my desktop/laptop are linux boxes), my bad 😞
I'm fixing it "blindly", because it looks easily, and there is no way for me to test.
Would you mind seeing if it works for you ? You would have to install it with:
go install github.com/janpfeifer/gonb@b0baf1e

If you let me knows whether it works, I'll create the v0.9.2 release so it's available to everyone with a Mac.
Again thanks for the report!

Actually I tested it with cross-compilation:
env GOOS=darwin GOARCH=arm64 go build -o /tmp/gonb_darwin_arm64 .

And it seems to have worked, so I'm hopeful 😄

Checked on my setup and go install github.com/janpfeifer/gonb@b0baf1e works!

I just released v0.9.2 with the fix :)


GRPC includeDirs problem

Hello,
There is a problem of relative path resolution for includeDirs option of GRPC.
I have project in /home/user/work/project1 (linux path) opened in vscode.
In this project i have folder "packages", which contains a lot of proto, example tree:
packages
├── package1
│   ├── some1
│   │   ├── some1.proto
│   │   └── some1_service.proto
│   └── package.json
├── package2
│   ├── entity.proto
│   ├── package.json
│   └── property.proto
├── package3
│   ├── some2_service.proto
│   └── package.json
└── grpc-list.http            <--- this is file, which I use to call grpc, listed bellow

And file grpc-list.http:
proto < ./package1/some1/some1_service.proto
includeDirs: ["./"]

GRPC {{host}}/.../List
{}

File ./package1/some1/some1_service.proto contains import like: import package1/some1/some1.proto
When i execute it, i got an exception:
ERROR: ExecuteHook: protoImport failed
ERROR: Error - ENOENT: no such file or directory, open '/home/user/work/project1/packages/package1/some1/package1/some1/some1.proto'
Error: ENOENT: no such file or directory, open '/home/user/work/project1/packages/package1/some1/package1/some1/some1.proto'

If i try to change includeDirs to "/home/user/work/project1/packages" or "./work/project1/packages" - it will work. But that's quit not an variant coz this is under version control and used by different developers =). It looks like it starts resolving of relative path from the HOME_DIR of the current user instead of project root folder.

Behavior has already been reported with AnWeber/httpyac#75. . I pass includeDirs directly into @grpc/proto-loader. Issue https://github.com/grpc/grpc-node/issues/1278#issuecomment-592086673 mentions that includeDirs should be absolute paths. Maybe you need to make an issue in @grpc/proto-loader (these lines need to be changed).
It is possible to simply workaround issue with javascript. The options are already treated as a javascript, therefore the current folder can just be inserted with __dirname.
proto < ./package1/some1/some1_service.proto
includeDirs: [`${__dirname}`]

GRPC {{host}}/.../List
{}

Uh, thank you so much, I'm was not able to google it correctly, sorry. Closing here.

You are welcome. Glad it works for you. Thanks for using my project:-)


[Bug] Border artifacts in about:config (related to  #131)

The list in about:config has the same border-top artifact issue as the library had in bug  #131

System:
Windows 7 64bit Pro N
Firefox Portable 60.0 (bug allready occured in 59)

I'll use the single userContent/Chrome.css files but adding the snippet at the bottom of the userContent.css did work.

Thanks! Just included it


Failed nuget restore on clean clone

The Microsoft Bot Framework team prefers that "How To" questions be submitted on Stack Overflow. The official Bot Framework GitHub repository  is the preferred platform for submitting bug fixes and feature requests.
Bot Info

SDK Platform: .NET
SDK Version: N/A
Active Channels: N/A
Deployment Environment: N/A

Issue Description
nuget restore errors on a clean checkout of the BotBuilder repo.  Applies to both the Bot.Builder solution and the Samples solution.
Code Example
N/A
Reproduction Steps

Clone botbuilder.
Launch CSharp/Microsoft.Bot.Builder.sln and restore.
Build the solution.
Launch CSharp/Samples/Microsoft.Bot.Builder.Samples.sln and restore.

Expected Behavior
Successful package restore in both solutions (both fail).  Successful build of the samples.
Actual Results
Bot.Builder solution:
Severity	Code	Description	Project	File	Line	Suppression State
Error		NuGet Package restore failed for project Tests\Microsoft.Bot.Sample.FormFlowAttachmentsBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Tests\Microsoft.Bot.Sample.FormFlowAttachmentsBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder.History'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.History.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Tests\Microsoft.Bot.Sample.FormFlowAttachmentsBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.

Samples solution:
Severity	Code	Description	Project	File	Line	Suppression State
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleAlarmBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder.History'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.History.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.BasicOAuth: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleFacebookAuthBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder.History'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.History.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.AlarmBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder.History'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.History.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleSandwichBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder.History'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.History.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.PizzaBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.BasicOAuth: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.AadV1Bot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleFacebookAuthBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.EchoBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder.History'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.History.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.AnnotatedSandwichBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder.History'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.History.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.GitHubBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.PizzaBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder.History'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.History.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.AlarmBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.AadV2Bot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.PizzaBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.AnnotatedSandwichBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.AlarmBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.FormFlowAttachmentsBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.AnnotatedSandwichBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder.FormFlow.Json'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.FormFlow.Json.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleSandwichBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.EchoBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.EchoBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.FormFlowAttachmentsBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleAlarmBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleAlarmBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.AadV1Bot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleEchoBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.FormFlowAttachmentsBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder.History'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.History.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.AnnotatedSandwichBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleSandwichBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleEchoBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder.History'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.History.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleDispatchDialog: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder.History'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.History.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.GitHubBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleDispatchDialog: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Connector'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Connector.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleDispatchDialog: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleEchoBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.
Error		NuGet Package restore failed for project Microsoft.Bot.Sample.SimpleFacebookAuthBot: Unable to find version '<IP_ADDRESS>621' of package 'Microsoft.Bot.Builder'.
  https://api.nuget.org/v3/index.json: Package 'Microsoft.Bot.Builder.<IP_ADDRESS>621' is not found on source 'https://api.nuget.org/v3/index.json'.
. Please see Error List window for detailed warnings and errors.

Thanks for reporting this.  We apologize for the inconvenience.  The package reference update to the samples was completed before the nuget packages were through the release cycle.  We will get this fixed asap, and the new nuget packages released.

Hello, is there any news on this one, please ? thanks

The bits are currently here: https://botbuilder.myget.org/gallery/botbuilder-v3-dotnet-daily they just aren't here yet: https://www.nuget.org/packages/Microsoft.Bot.Builder/

Looks good, thanks!


Updating connection with guard rail gives an error

When a connection as an associated guard rail, and you try to edit that connection again (without touching the guard rail field), saving fails with the error:

failed creating guard rail association, reason=ERROR: invalid input syntax for type uuid: "" (SQLSTATE 22P02)

If you re-select the guard rail(s) in the form, and then save, everything works fine.

Full stack trace in k8s (click to expand)

github.com/hoophq/hoop/gateway/api/connections.Put
/home/runner/work/hoop/hoop/gateway/api/connections/connections.go:197
github.com/gin-gonic/gin.(*Context).Next
/home/runner/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/hoophq/hoop/gateway/api.(*Api).buildRoutes.(*Api).TrackRequest.func10
/home/runner/work/hoop/hoop/gateway/api/middleware.go:87
github.com/gin-gonic/gin.(*Context).Next
/home/runner/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/hoophq/hoop/gateway/api/apiroutes.(*Router).setUserContext
/home/runner/work/hoop/hoop/gateway/api/apiroutes/auth.go:133
github.com/hoophq/hoop/gateway/api/apiroutes.(*Router).AuthMiddleware
/home/runner/work/hoop/hoop/gateway/api/apiroutes/auth.go:118
github.com/gin-gonic/gin.(*Context).Next
/home/runner/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/hoophq/hoop/gateway/api/apiroutes.AdminOnlyAccessRole
/home/runner/work/hoop/hoop/gateway/api/apiroutes/roles.go:50
github.com/gin-gonic/gin.(*Context).Next
/home/runner/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
go.opentelemetry.io/contrib/instrumentation/github.com/gin-gonic/gin/otelgin.Middleware.func1
/home/runner/go/pkg/mod/go.opentelemetry.io/contrib/instrumentation/github.com/gin-gonic/gin/otelgin@v0.49.0/gintrace.go:95
github.com/gin-gonic/gin.(*Context).Next
/home/runner/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/getsentry/sentry-go/gin.(*handler).handle
/home/runner/go/pkg/mod/github.com/getsentry/sentry-go@v0.18.0/gin/sentrygin.go:57
github.com/gin-gonic/gin.(*Context).Next
/home/runner/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/hoophq/hoop/gateway/api.(*Api).StartAPI.CORSMiddleware.func2
/home/runner/work/hoop/hoop/gateway/api/middleware.go:120
github.com/gin-gonic/gin.(*Context).Next
/home/runner/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/hoophq/hoop/gateway/api.(*Api).StartAPI.RecoveryWithZap.CustomRecoveryWithZap.func4
/home/runner/go/pkg/mod/github.com/gin-contrib/zap@v0.2.0/zap.go:159
github.com/gin-gonic/gin.(*Context).Next
/home/runner/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/context.go:174
github.com/gin-gonic/gin.(*Engine).handleHTTPRequest
/home/runner/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:620
github.com/gin-gonic/gin.(*Engine).ServeHTTP
/home/runner/go/pkg/mod/github.com/gin-gonic/gin@v1.9.1/gin.go:576
net/http.serverHandler.ServeHTTP
/opt/hostedtoolcache/go/1.23.4/x64/src/net/http/server.go:3210
net/http.(*conn).serve
/opt/hostedtoolcache/go/1.23.4/x64/src/net/http/server.go:2092

Some more info:

Using the web admin interface.
webapp version 1.35.1
gateway version 1.31.10

This issue has been resolved in 95d2f7d17dfd148d61d991d6eea27f916a987c36
And will be available in the version 1.31.12


Ensure projects are updated for find all references

Fixes #52316.
There are a few places inside the find all references workflow that looks for references across projects, where we have a file A and a project P, and we assume that file A is contained in project P. However, the project could be outdated (i.e. it changed but we haven't updated it yet), and in some situations we were using this outdated information to determine that file A is contained in project P, when it no longer is. This would lead to a crash, because when later in the code we try to validate that file A is contained in project P, P is finally updated, and no longer has file A, so we throw an exception saying we couldn't find file A.
The fix in this PR is to ensure all projects are updated at the start of the find all references workflow, so that we always use updated information about files and containing projects.

I'd be curious to know whether larger project references codebases see any regressions as a result of this.

@typescript-bot perf test this

@typescript-bot perf test this


perf(animation): using will-change when progressStep()

Before:

After:

Ionic Version: 2.x

This was applied on slides too? Very, very poor fps on Android devices...


fix: suppress [object Object] defaults (probably Org flags)

@W-13215411@
https://github.com/salesforcecli/plugin-command-reference/pull/652 has the UT without the fix so you can prove the test is testing properly

QA:

✅  set global target-org config var, generated files shouldn't contain "Default value: [object Object]"?
✅  set local target-org config var, generated files shouldn't...
✅  set global target-dev-hub config var, generated files shouldn't...
✅  set local target-dev-hub config var, generated files shouldn't...
❌ generate full set of command reference files with both config vars set to something, then compare output to currently checked in files, they should be the same.
- The DITA files for "org delete scratch" and "org delete sandbox" now include a default value for --target-org (the value of my target-org config var).  They didn't before. These are the only commands that do this -- other commands, such as "project deploy start", omit the default value of --target-org, which is correct for the CLI Reference.


Beta warning on winapi 0.2.5

In case if you haven't found it yet:
C:\Users\appveyor\.cargo\registry\src\github.com-48ad6e4054423464\winapi-0.2.5\src\macros.rs:159:46: 159:47 warning: `$fieldtype:ty` is followed by `[`, which is not allowed for `ty` fragments
C:\Users\appveyor\.cargo\registry\src\github.com-48ad6e4054423464\winapi-0.2.5\src\macros.rs:159     ($base:ident $field:ident: $fieldtype:ty [
                                                                                ^
C:\Users\appveyor\.cargo\registry\src\github.com-48ad6e4054423464\winapi-0.2.5\src\macros.rs:159:46: 159:47 note: The above warning will be a hard error in the next release.
C:\Users\appveyor\.cargo\registry\src\github.com-48ad6e4054423464\winapi-0.2.5\src\macros.rs:159     ($base:ident $field:ident: $fieldtype:ty [

The issue was already discovered, an RFC to fix it was proposed, accepted, and implemented. Thanks for your concern though.

Oh... that's good. These warnings that'll become errors always look scary :)


Calling focus on AceEditor doesn't work the first time

Describe the bug
The first time we call AceEditor#focus does nothing and (TypeError) : Cannot read property 'focus' of undefined is displayed by Vaadin. The editor is already attached but has not been rendered yet. Calling focus works on subsequent calls.
Looks like problem in lit-ace.js. focusEditor method istrying to call this.editor.focus() while this.editor is undefined.  this.editor is lazily initialized in firstUpdated. Could the initialization be moved to constructor? The same error happens when calling setCursorPosition before firstUpdated .
To Reproduce
Clicking on tabs of class described below causes the error.
Tab tab1 = new Tab("Tab1");
Tab tab2 = new Tab("Tab2");
tabs = new Tabs();
tabs.add(tab1, tab2);

Div div = new Div();
AceEditor aceEditor = new AceEditor();
aceEditor.setInitialFocus(true);
aceEditor.setVisible(false);

VerticalLayout layout = new VerticalLayout();
layout.add(tabs, div, aceEditor);
tabs.addSelectedChangeListener(e -> {
	if (div.isVisible()) {
		div.setVisible(false);
		aceEditor.setVisible(true);
		aceEditor.focus();
	} else {
		div.setVisible(true);
		aceEditor.setVisible(false);
	}
});

Screenshot

you clould use .setInitialFocus(true); to have the editor focussed when rendered.

and I will be adding the securitys to not throw these errors anymore

I fixed #10 and #11 on cloned version. Shoul I send you diff?


dotnet run / watch on MacOS cannot load StereoKitC

Description
When do either dotnet run or dotnet watch, the logs state that StereoKitC cannot be found, even though it's installed, and building to device works as well. Is this something Mac specific, or am I doing something wrong? I get the issue when doing the exact steps in the Getting Started VS Code documentation
Platform / Environment
I'm working on M1 macOS 14.1, I'm using latest VS Code 1.84.1. I've installed dotnet 7.0.483, the android workload, openJDK 17, Android API level 33 via Android Studio, Xamarin via VS.
Stereokit was installed (latest), as was the Templates (latest)
Logs or exception details
➜  ProjectName dotnet run
[SK error] Failed to load StereoKitC!
Unhandled exception. System.DllNotFoundException: Unable to load shared library 'StereoKitC' or one of its dependencies. In order to help diagnose loading problems, consider setting the DYLD_PRINT_LIBRARIES environment variable:
dlopen(/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/StereoKitC.dylib, 0x0001): tried: '/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/StereoKitC.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/StereoKitC.dylib' (no such file), '/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/StereoKitC.dylib' (no such file)
dlopen(/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/StereoKitC.dylib, 0x0001): tried: '/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/StereoKitC.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/StereoKitC.dylib' (no such file), '/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/StereoKitC.dylib' (no such file)
dlopen(StereoKitC.dylib, 0x0001): tried: 'StereoKitC.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OSStereoKitC.dylib' (no such file), '/usr/lib/StereoKitC.dylib' (no such file, not in dyld cache), 'StereoKitC.dylib' (no such file), '/usr/local/lib/StereoKitC.dylib' (no such file), '/usr/lib/StereoKitC.dylib' (no such file, not in dyld cache)
dlopen(/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/libStereoKitC.dylib, 0x0001): tried: '/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/libStereoKitC.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/libStereoKitC.dylib' (no such file), '/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/libStereoKitC.dylib' (no such file)
dlopen(/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/libStereoKitC.dylib, 0x0001): tried: '/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/libStereoKitC.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/libStereoKitC.dylib' (no such file), '/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/libStereoKitC.dylib' (no such file)
dlopen(libStereoKitC.dylib, 0x0001): tried: 'libStereoKitC.dylib' (no such file), '/System/Volumes/Preboot/Cryptexes/OSlibStereoKitC.dylib' (no such file), '/usr/lib/libStereoKitC.dylib' (no such file, not in dyld cache), 'libStereoKitC.dylib' (no such file), '/usr/local/lib/libStereoKitC.dylib' (no such file), '/usr/lib/libStereoKitC.dylib' (no such file, not in dyld cache)
dlopen(/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/StereoKitC, 0x0001): tried: '/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/StereoKitC' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/StereoKitC' (no such file), '/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/StereoKitC' (no such file)
dlopen(/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/StereoKitC, 0x0001): tried: '/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/StereoKitC' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/StereoKitC' (no such file), '/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/StereoKitC' (no such file)
dlopen(StereoKitC, 0x0001): tried: 'StereoKitC' (no such file), '/System/Volumes/Preboot/Cryptexes/OSStereoKitC' (no such file), '/usr/lib/StereoKitC' (no such file, not in dyld cache), 'StereoKitC' (no such file), '/usr/local/lib/StereoKitC' (no such file), '/usr/lib/StereoKitC' (no such file, not in dyld cache)
dlopen(/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/libStereoKitC, 0x0001): tried: '/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/libStereoKitC' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/libStereoKitC' (no such file), '/usr/local/share/dotnet/shared/Microsoft.NETCore.App/7.0.13/libStereoKitC' (no such file)
dlopen(/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/libStereoKitC, 0x0001): tried: '/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/libStereoKitC' (no such file), '/System/Volumes/Preboot/Cryptexes/OS/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/libStereoKitC' (no such file), '/Users/mrstruijk/Current StereoKit Projects/ProjectName/bin/Debug/net7.0/libStereoKitC' (no such file)
dlopen(libStereoKitC, 0x0001): tried: 'libStereoKitC' (no such file), '/System/Volumes/Preboot/Cryptexes/OSlibStereoKitC' (no such file), '/usr/lib/libStereoKitC' (no such file, not in dyld cache), 'libStereoKitC' (no such file), '/usr/local/lib/libStereoKitC' (no such file), '/usr/lib/libStereoKitC' (no such file, not in dyld cache)
at StereoKit.NativeAPI.sk_step(Action app_update)
at StereoKit.SK.Step(Action onStep) in //StereoKit/SK.cs:line 198
at StereoKit.SK.Run(Action onStep, Action onShutdown) in //StereoKit/SK.cs:line 227
at Program.$(String[] args) in /Users/mrstruijk/Current StereoKit Projects/ProjectName/Program.cs:line 4

Ajjj! That's unfortunate. Not a worry though. Thanks for the info :)


Fix clock equals 0 on first evaluation

Motivation
On evaluating clock for the first time it was equal to zero
Changes
Observing _displayLink I noticed that for the first time when it's being set, the value of _displayLink.timestamp (and _displayLink.targetTimestamp as well) was equal zero from some unknown reason.
However, I have found it pointless to look for bug here and actually cannot see why it's somehow better than CACurrentMediaTime.
What's more, I made _wantRunUpdates usable again.
Made some refactor.

@osdnk thank you! this fix issue with clock bug

@kmagiera Hi, can you merge it?


2.1.4

Bump to version 2.1.4
This release includes:

Fix on #329 by @gustavkj
Dependency updates

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
238

Relevant Lines:
238

💛  - Coveralls

@gagoar I think NPM might have started requiring 2FA for personal tokens, you might have to create a new automation token that wont require 2FA.

I'm just picking this up again. Fixing soon, sorry @gustavkj

@gagoar No worries 🙂


replication_mode: fix config issues

What problem does this PR solve?
Fix #2386
Fix #2387
Fix #2388
What is changed and how it works?

change dr_auto_sync to dr-auto-sync (and auto convert _ to -)
validate config, if wrong return error
support pd-ctl set numbers (e.g. primary-replicas)
switch status to sync_recover when the label key is updated

Check List
Tests

Unit test

/merge

/merge

/merge

/merge

/run-all-tests


apigateway Integration is not being created

What happened?

The integration of apigateway is not being created. No status or error message are printed either.
kubectl get integration.apigateway.aws.crossplane.io
NAME          READY   SYNCED   EXTERNAL-NAME
apigateway
apisoftware

How can we reproduce it?

apiVersion: apigateway.aws.crossplane.io/v1alpha1
kind: Integration
metadata:
  name: apigateway
spec:
  providerConfigRef:
    name: my-aws
  forProvider:
    # httpMethod: OPTIONS
    httpMethod: "OPTIONS"
    region: eu-west-1
    resourceIdRef:
      name: apigateway
    restApiId: hs281xxxx
    # type_: MOCK
    type_: "MOCK"

What environment did it happen in?
Crossplane version:
image: crossplane/crossplane:v1.10.1
image: xpkg.upbound.io/crossplane-contrib/provider-aws:v0.36.1

Is it a known issue?
Maybe we can get ahow-to  create a apigw integration?
We are realy struggling with it.

I think this is caused by and related to #1573

/fresh Is there any update or resolution for this issue?


[Task] Reconcile the heading hierarchy (h1 -> h5)

Current behavior

sometimes a certain heading level (h3) is called for in the styling, but in the hierarchy of the heading markdown should be something else (h2). Headings should be arranged from h1 to h5 for accessibility

Expected behavior

Headings should be arranged from h1 to h5 for accessibility

Screenshots

I think this has been resolved. Going to just put it on my personal list to double-check once we have more pages.


Added Qualys app and documentation

Looks amazing Dhaval. Could you share a Workflow for it as well?

Looks amazing Dhaval. Could you share a Workflow for it as well?

Hey, I've shared the app and workflow for Qualys on shuffler. Do you want me to share here in this repo as well?

Sure - any reference in general is pretty good. Just paste a link here somewhere for now is fine :)

Sure - any reference in general is pretty good. Just paste a link here somewhere for now is fine :)

Here is link to the sample workflow.


[Macros] Fix lookup of macro-produced variables (#65939)

Cherry-pick #65939 into release/5.9

Explanation: Macro-produced variables could not be found because the way we retrieved the parent source file from a macro-produced decl did not work on PatternBindingDecls. The fix is to switch to using getSourceFileContainingLocation as a more reliable approach.
Scope: This touches the lazy macro expansion logic (MissingDecl) and the logic adding members to an IterableDeclContext.
Risk: Low. Source-location-based source file retrieval is more reliable, but we fall back to the old approach upon invalid source locations.
Testing: Added test cases, and updated an existing test that has been fixed.
Issue: rdar://109376568
Reviewers: @DougGregor

@swift-ci please test


ipv6: disable IPv6-only shared network with VR

Description
This PR fixes #5640 by disabling IPv6-only Shared network with VR provider.

Types of changes

[ ] Breaking change (fix or feature that would cause existing functionality to change)
[ ] New feature (non-breaking change which adds functionality)
[x] Bug fix (non-breaking change which fixes an issue)
[ ] Enhancement (improves an existing feature and functionality)
[ ] Cleanup (Code refactoring and cleanup, that may add test cases)

Feature/Enhancement Scale or Bug Severity
Feature/Enhancement Scale

[ ] Major
[ ] Minor

Bug Severity

[ ] BLOCKER
[ ] Critical
[ ] Major
[x] Minor
[ ] Trivial

Screenshots (if appropriate):
How Has This Been Tested?

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_multiplication_x: el7 :heavy_multiplication_x: el8 :heavy_multiplication_x: debian :heavy_multiplication_x: suse15. SL-JID 2013

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_multiplication_x: el7 :heavy_multiplication_x: el8 :heavy_multiplication_x: debian :heavy_multiplication_x: suse15. SL-JID 2014

@blueorangutan package

@blueorangutan package

@rohityadavcloud a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_multiplication_x: el7 :heavy_multiplication_x: el8 :heavy_check_mark: debian :heavy_multiplication_x: suse15. SL-JID 2029

@blueorangutan package

@sureshanaparti a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 2034

@blueorangutan test

@sureshanaparti a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-2751)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 37871 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5810-t2751-kvm-centos7.zip
Smoke tests completed. 90 look OK, 1 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_05_ping_in_cpvm_success
Failure
14.37
test_diagnostics.py

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 2108

@blueorangutan test

@weizhouapache a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 2121

@blueorangutan test

@weizhouapache a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

@blueorangutan package

@weizhouapache a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 2125

Trillian test result (tid-2806)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 35292 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5810-t2806-kvm-centos7.zip
Smoke tests completed. 87 look OK, 5 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

test_01_add_primary_storage_disabled_host
Error
0.65
test_primary_storage.py

test_01_primary_storage_nfs
Error
0.13
test_primary_storage.py

ContextSuite context=TestStorageTags>:setup
Error
0.24
test_primary_storage.py

test_03_deploy_and_scale_kubernetes_cluster
Failure
35.01
test_kubernetes_clusters.py

test_07_deploy_kubernetes_ha_cluster
Failure
80.28
test_kubernetes_clusters.py

test_08_upgrade_kubernetes_ha_cluster
Failure
41.11
test_kubernetes_clusters.py

test_09_delete_kubernetes_ha_cluster
Failure
0.05
test_kubernetes_clusters.py

ContextSuite context=TestKubernetesCluster>:teardown
Error
77.19
test_kubernetes_clusters.py

test_01_secure_vm_migration
Error
162.65
test_vm_life_cycle.py

test_02_unsecure_vm_migration
Error
272.46
test_vm_life_cycle.py

test_03_secured_to_nonsecured_vm_migration
Error
148.04
test_vm_life_cycle.py

test_08_migrate_vm
Error
45.92
test_vm_life_cycle.py

test_02_list_snapshots_with_removed_data_store
Error
9.49
test_snapshots.py

test_02_list_snapshots_with_removed_data_store
Error
9.49
test_snapshots.py

test_hostha_enable_ha_when_host_in_maintenance
Error
302.88
test_hostha_kvm.py

@blueorangutan test

@weizhouapache a Trillian-Jenkins test job (centos7 mgmt + kvm-centos7) has been kicked to run smoke tests

Trillian test result (tid-2822)
Environment: kvm-centos7 (x2), Advanced Networking with Mgmt server 7
Total time taken: 43297 seconds
Marvin logs: https://github.com/blueorangutan/acs-prs/releases/download/trillian/pr5810-t2822-kvm-centos7.zip
Smoke tests completed. 92 look OK, 0 have errors
Only failed tests results shown below:

Test
Result
Time (s)
Test File

@sureshanaparti a Jenkins job has been kicked to build packages. I'll keep you posted as I make progress.

Packaging result: :heavy_check_mark: el7 :heavy_check_mark: el8 :heavy_check_mark: debian :heavy_check_mark: suse15. SL-JID 2165

@blueorangutan test keepEnv

Verified the changes. LGTM

Great, thanks for testing


Add Intel jenkins trigger

This is a direct copy provided by Intel, and is not maintained by myself or others in Microsoft.
Signed-off-by: Chris Yan<EMAIL_ADDRESS>

Closed in favor of https://github.com/openenclave/openenclave/pull/3952


Cayley appears to drop quads on loads when duplicate rows exist

In the tests below, which simplifies to a .nq with just few rows, the "Alice" vertex will disappear depending on the load order of the items. This is using the "cquad" format on 0.4.0.
A sort | uniq on the command line may be a workaround.

expected behavior testcase1.nq:
  "Bob" "knows" "A" .
  "Alice" "knows" "B" .
  "Bob" "knows" "A" .

g.Emit(g.V("Bob").All())
  {
   "result": [
    {
     "id": "Bob"
    },
    "null"
   ]
  }

g.Emit(g.V("Alice").All())
  {
   "result": [
    {
     "id": "Alice"
    },
    "null"
   ]
  }

buggy behavior testcase2.nq:
  "Bob" "knows" "A" .
  "Bob" "knows" "A" .
  "Alice" "knows" "B" .

g.Emit(g.V("Bob").All())
  {
   "result": [
    {
     "id": "Bob"
    },
    "null"
   ]
  }

g.Emit(g.V("Alice").All())
  {
   "result": [
    {
     "id": ""
    },
    "null"
   ]
  }

expected behavior testcase3.nq:
  "Alice" "knows" "B" .
  "Bob" "knows" "A" .
  "Bob" "knows" "A" .
  "Alice" "knows" "B" .

g.Emit(g.V("Bob").All())
  {
   "result": [
    {
     "id": "Bob"
    },
    "null"
   ]
  }

g.Emit(g.V("Alice").All())
  {
   "result": [
    {
     "id": "Alice"
    },
    "null"
   ]
  }

Probably a good catch, and I can repro on v0.4.0. I think you're running off of the binary distro? There's been some helpful changes around duplicate quads (including explicit ignoring thereof) on HEAD.
So I think the real issue here is I need to release a 0.4.1 soon. There are enough minor bugs to warrant it.

I'm on a binary and will checkout HEAD. Thank you. :+1:

Resolved on HEAD. Closing.


[Question] Resolution selection problem(CLIP for 224px or 336px)

Question
Hi @haotian-liu , will llava1.5 performance drop during inference, if using openai/clip-vit-large-patch14 instead of openai/clip-vit-large-patch14-336? Thanks very much!

I guess so, since reading from the paper increasing the resolution to 336 gives a performance boost. It's one of the main difference from the earlier version of llava. If you want to understand and be sure just read the paper.


Quick reload on continuous listening panel

One thing I notice I end up doing is leaving the continuous listening panel and then back into it often. Sometimes Finale will stop scrobbling and I'll have to reinitiate the continuous listening. I'm wondering if a quick reload button would solve that problem for me.
Related, but would be a different feature that I'm not sure if this is possible, but I'd love some type of visual indicator that it's been X minutes since the last scrobble. So I can visually see that it's probably stopped scrobbling.

Currently, the continuous scrobbler only scrobbles while you're on that screen, so if you go back and browse elsewhere in the app, it'll stop listening. I could rework it so that you can browse the app and still have it recognize in the "background".
Unfortunately, due to iOS limitations, the app has to be active in order for it to use the microphone (so it's impossible for it to continue listening if the phone is locked or you switch to another app -- I believe this is true, but I'll double check). Would this be useful to you?

My goal with this was less about navigating the app, it was about reinitiating the continuous listening session.

Sometimes it freezes after scrobbling for awhile and just needs a fresh session
I want to catch the end of a song on radio, but the app isn't listening right at that second. Being able to quick refresh to catch that song would be handy.

This feature has been implemented, so I'm going to go ahead and close this issue. Feel free to reopen if needed.


Adds article about interactors and design systems

Motivation
Article about interactors and design systems
Approach
Taras provided an outline, I wrote it out, Jeffrey edited, and Dmitry provided screenshots

I fixed the URL of that image, thanks! about the code highlighting, it does have JS but I guess the parser we have installed in this gatsby instance is bad.

New commits pushed that slim things down a lot: https://deploy-preview-148--frontside.netlify.app/blog/2021-08-04-interactors-design-systems/

Really good! thanks Jeffrey!


allow setting resources & securityContext in Helm Chart values

one of the best practices for operating workloads in Kubernetes is to set resource requests and limits as well as securityContext related settings.
This PR introduces the possibility to set those resource requests and limits as well as securityContext related settings. Since the exact settings cant be known and depend on the environment as well as the number and complexity of camel routes, users will be able to freely define their settings in the values.yaml.

Release Note
NONE

As I don't know much about helm I cannot check if it's ok or not. Can anyone review this? @squakez @phantomjinx

Not familiar with Helm charts, hopefully @phantomjinx can have a look.

Let's merge for 1.10.0


Play a beep (sound)

Is it possible?
I would want to try to write a simple app in python.

Term48 implements the terminal BEL character as a screen flash, and doesn't make the system audibly beep.
Linking to the audio system should be doable from python though, but I am not familiar with how to do it myself. Most of the stuff I found on the topic point to winsound (Windows only) or suggest printing a BEL character, which will just make Term48 flash the screen.

Ok..i tried to cat something to /dev/snd/* but i had permission denied. I installed pyglet and tried loading a wav file but i got some other riffformat error. I will try something more.

Please try https://github.com/blackberry/Core-Native-Community-Samples/tree/master/ToneGenerator/src https://github.com/blackberry/Core-Native-Community-Samples/tree/master/ToneGenerator/src
For Python, it should be possible to make python extension wrapping ALSA.

On Jan 7, 2016, at 18:03, schef<EMAIL_ADDRESS>wrote:
Ok..i tried to cat something to /dev/snd/* but i had permission denied. I installed pyglet and tried loading a wav file but i got some other riffformat error. I will try something more.
—
Reply to this email directly or view it on GitHub https://github.com/mordak/Term48/issues/10#issuecomment-169834841.

This works too: https://github.com/idispatch/SDL_mixer
I use it in https://github.com/idispatch/toppler

Hi,
you may play any sound easily through Term48 using lib-nixtla-audio, based on OpenAL;
https://github.com/nicaraguabinary/lib-nixtla-audio
I had to make some very slight ajustments to have it compile for bb10
https://github.com/berryamin/lib-nixtla-audio/tree/compile_on_ElCapitan_for_bb10


Store the latest DipDup version in dipdup_meta

a.k.a. stop DoS'ing GitHub on every run

Oops, duplicate #1095


Added types.

I was struggling to get typescript working with this package. DefinitelyTyped has an entry for "assert", but it doesn't declare "assert" as a module. As far as I can tell, this is because people often conflict between node.d.ts and the use of assert as an external package.
Realistically, node users should use node.d.ts (and node's built-in assert module), and developers of sites and apps that require packing should use your commonjs-assert package along with its own type definition.
This would've all been avoided if this module was actually called "commonjs-assert" on npm instead of just "assert", but we're a bit beyond that.
--
Anyway, this pull request contains the proper type definitions tightly coupled with the commonjs-assert module which means consumers of the module won't need to add a separate external dependency on @types/assert or any other such type definitions.

shouldn't this just be on definitely typed ?

As far as I understand it, DefinitelyTyped exists only because the creators of type definitions are not necessarily (or usually) the same people as the creators of modules themselves. Bringing the type definitions into the module makes it far easier for users to consume them and also ensures that the type definition version matches that of the module (a common problem when using DefinitelyTyped).
Furthermore, DefinitelyTyped already has type definitions under the name "assert", but they're meant for power-assert. DefinitelyTyped also has definitions for node which include "assert", but that also brings definitions for other first-party node modules. It's messy over there, and best if avoided.

It sounds like the root of the issue is that defiantly typed has the wrong
assert package?
On Mon, Oct 3, 2016, 2:43 AM Brent Traut<EMAIL_ADDRESS>wrote:

As far as I understand it, DefinitelyTyped exists only because the
creators of type definitions are not necessarily (or usually) the same
people as the creators of modules themselves. Bringing the type definitions
into the module makes it far easier for users to consume them and also
ensures that the type definition version matches that of the module (a
common problem when using DefinitelyTyped).
Furthermore, DefinitelyTyped already has type definitions under the name
"assert", but they're meant for power-assert. DefinitelyTyped also has
definitions for node which include "assert", but that also brings
definitions for other first-party node modules. It's messy over there, and
best if avoided.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/defunctzombie/commonjs-assert/pull/25#issuecomment-251066182,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ABE4n5CqatyxkQnzBTaDrf3qJ60ylwNtks5qwM5JgaJpZM4KMSiB
.

It seems that way. I'm also adding a pull request on that side.
I still feel as if tighter bundling of code and types is better (ie: this pull request), but that's your call as a maintainer.

See: https://github.com/DefinitelyTyped/DefinitelyTyped/pull/11695


A rename error occurs when using abstract_target.

Hi!
A rename error occurs when using abstract_target.
KRPullLoader.swift
open func setup {
activityIndicator.style -> occured!!!
}

@devny
Is abstract_target Podfile syntax?

Swift version is 4.2.1
this lib version is 1.2.0

@devny
I tried abstract_target, bud clean.
Isn't there a possibility of the other parts?
Please show me error messages. (texts or screenshots)

no response.


Updated cleanup code for compatibility with latest param unwatch

Codecov Report

Merging #72 into master will decrease coverage by 0.62%.
The diff coverage is 69.9%.

@@            Coverage Diff             @@
##           master      #72      +/-   ##
==========================================
- Coverage   91.11%   90.48%   -0.63%
==========================================
  Files          23       23
  Lines        3028     3059      +31
==========================================
+ Hits         2759     2768       +9
- Misses        269      291      +22

Impacted Files
Coverage Δ

panel/tests/test_panes.py
98.27% <100%> (ø)
:arrow_up:

panel/tests/test_reactive.py
100% <100%> (ø)
:arrow_up:

panel/widgets.py
96.61% <100%> (ø)
:arrow_up:

panel/param.py
91.37% <100%> (+0.51%)
:arrow_up:

panel/tests/test_plotly.py
97.77% <100%> (ø)
:arrow_up:

panel/tests/test_param.py
100% <100%> (ø)
:arrow_up:

panel/viewable.py
67.63% <43.47%> (-8.85%)
:arrow_down:

panel/interact.py
78.03% <57.14%> (-0.44%)
:arrow_down:

panel/pane.py
80.51% <90.9%> (+0.44%)
:arrow_up:

panel/layout.py
95.45% <91.66%> (+0.07%)
:arrow_up:

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f583da8...292959f. Read the comment docs.


backport IAVL to v3.1.0 and v4.2.0

Background
We would like to backport the fast storage IAVL changes to v3.x and v4.x
Being able to do this is important safety-wise and for future features. We shouldn’t be only relying on a centralized server to download archive nodes all the time.
Basically, these IAVL changes backported would allow us to sync from gen way faster from the first block. It is also important if we want to transition to a different database since we would have to replay the entire state.
Notes

we skip v5.x because it is state-compatible with v6.x.
we skip v2.x because there was an SDK issue
we skip v1.x because it is not state-compatible with itself

Acceptance  Criteria

[ ] #3518
[ ] #3519

Hi, I'm on this, currently working on updating the cosmos sdk stuff needed for it.

I am midway through making a rocks archive node automatcially.  Right. now the main holdup is that I haven't automated it yet, pretty sure that with automation it is less than 24h total sync time.

Lets close, and target this via IAVL v1


(OUI Docs) Remove illustration from folders & refereneces to illustration

As a follow up to the comment in this pr: https://github.com/opensearch-project/oui/pull/500 - the illustration needs to be removed entirely so it does not show up in the homepage (done) or as the share image, or potentially anywhere else within the project.

Notably, this line needs to be removed as well: https://github.com/opensearch-project/oui/blob/f5d7aa66fa05e211f60b20cd26612472da9e5ee0/src-docs/src/index.html#LL25C40-L25C134


Fixes Errno::ENOENT on rake neo4j:install

Fixes #
open was referring to Kernal open method instead of URI.open causing:
Errno::ENOENT: No such file or directory @ rb_sysopen - http://dist.neo4j.org/neo4j-community-3.0.0-unix.tar.gz
This fixes it.
Pings:
@cheerfulstoic
@subvertallchris

This is a simple fix can we merge this?


Update "activeTab" when BN receives props

Hello!
I added updating "activeTab" state when BottomNavigation receives new props.
It may be useful if you change tab from other components.
Thanks for your work!

Hi! Thank you for contributing. Unfortunately, I didn't saw your Pull Request until now. I forgot to turn on email-notifications. 🤦♂
I added this feature today and pushed it.
Although your solution looks very straight-forward, it would just set the Tab active without running all Animations. The Animations (respectively the Ripple Animations) are located BottomNavigation.js, because overflow: 'visible' doesn't work in Android, and so I can't put the Ripples inside the Tabs. It's a bit hacky (I don't like calling such methods in other Components via this.refs), but in my experiments it was the only way to achive this.
I'm very sorry I didn't saw your PR earlier and thus implemented it without you. I turned on email-notifications, pinky swear.

good job!

Although your solution looks very straight-forward, it would just set the Tab active without running all Animations.

It because I didn't press on tab. Animation - is a visual feedback for user action.
0.3.0 works fine for me, but if I change tab from some menu (e.g drawer), animation is still running.

Animation - is a visual feedback for user action.

That's a good point. The small Ripple-TouchFeedback shouldn't be visible. But imho the transition of the background color should stay the same, no matter if the user pressed the tab or the change was triggered programmatically.


Add integration upgrade test on older version

Changes
This commit adds the integration test on older version to prevent regression of current changes.
Test case for regression:

Remove the pointer expression of a field.

/kind misc
Submitter Checklist
As the author of this PR, please check off the items in this checklist:

[n/a] Has Docs included if any changes are user facing
[x] Has Tests included if any functionality added or changed
[x] Follows the commit message standard
[x] Meets the Tekton contributor standards (including
functionality, content, code)
[x] Has a kind label. You can add one by adding a comment on this PR that contains /kind <type>. Valid types are bug, cleanup, design, documentation, feature, flake, misc, question, tep
[n/a] Release notes block below has been updated with any user facing changes (API changes, bug fixes, changes requiring upgrade notices or deprecation warnings)
[x] Release notes contains the string "action required" if the change requires additional action from users switching to the new release

Release Notes
NONE

Current status:

Trying to catch the regression of https://github.com/tektoncd/pipeline/issues/4913 as an example.
Reverting fixes https://github.com/tektoncd/pipeline/pull/4914/files to test if this shall be catched.

/hold cancel

/retest

/retest

/test check-pr-has-kind-label

Updated the test case to prove this workable, and test case updated at https://github.com/JeromeJu/pipeline/tree/upgrade-regression-test. PTAL @lbernick :pray:


object with null value attribute handling

Description:
Hello,
First of all, Thank you for this awesome opensource,
I'm considering using yorkie for concurrent data sync for my project,
So, I'm on a POC now.
While assigning json object into root Object
root['stateData'] = state;
It crashed with 'TypeError: Cannot convert undefined or null to object' at object_proxcy.ts@171 line
I debuged the point and found that object with null value attribute( { hello: null } crashes at that line.
Why:
As you know, in JS, type of null is 'object',
so, null value goes to this code block
Object.entries(value!)
and it crashes.
Do you have any plan for null value support?
if not, it would be nice to give a guide to how to handle null value,
Thank your for your awesome lib again.

@Lee-Minjea Thanks for the report. We'll test out a few things and give you feedback.

How to reproduce it (as minimally and precisely as possible):
When the user edits as follows, the error occurs.
it('null value test', function () {
  const doc = Document.create('test-col', 'test-doc');
  doc.update((root) => {
    root.data = {
      null: null
    };
  });
  assert.equal(`{"null":null}`, doc.toSortedJSON());
});

@Lee-Minjea We considered setting null values in the design stage, but we haven't implemented them yet(
We had forgotten it). We plan to apply in the next release.

@hackerwins
Thank you for the respond,
I would be great with null value support.
I'm looking forward !

@Lee-Minjea We have released v0.1.3 which solved the problem you reported. Thank you.

https://github.com/yorkie-team/yorkie/releases/tag/v0.1.3
https://github.com/yorkie-team/yorkie-js-sdk/releases/tag/v0.1.3


Api trigger experiment

Triggers that call external APIs, callback functions, preprocessors & unit tests
Sams state functionality and making it pretty

pinging @mapsam & @creade and @bengolder to make sure we're all good on this Pull Request. Ideally we would like to merge by Monday

I'm going to merge this into master because it's basically become the new default master branch.


Add code of conduct to static site...

This branch introduces two changes:

I've added copy of the code of conduct so I have somewhere that's not a wiki I can link to from the ticket booking form (attendees should tick a check box to say they have read, understood and agree to abide by the CoC as part of the ticket booking process).
I've updated the _config.yml file so the URL is for our pyconuk.org website.

<3
Will have a poke at errors, apologies

Yeah, another example of https://github.com/gjtorikian/html-proofer/issues/170 alas
Check out https://github.com/PyconUK/pyconuk.github.io/pull/20 - that should fix this

@doismellburning I've merged #20 and have triggered another build of this PR (it didn't seem to be happening automatically, but maybe I was just being impatient) but it's failed, I think for the same reasons.
I'm going to merge this now because the build is failing for spurious reasons.

It failed for the same reasons, because, though #20 was merged, this PR didn't include it.
Ideally either @ntoll would have then merged master into his branch, or we'd have created a new PR and cherry-picked his commits into that - would you mind if we did that in future please? Cheers