[DataStorage] APIs to add Event and delete Events from database based on event ids

Signed-off-by: Nitu Gupta<EMAIL_ADDRESS>Description
Currently DataStorage has APIs to add data to the database or get the reading. API to delete a record from database is not present. This PR will add an API to delete record from CoreData given the Event ID
Usage Example
Add an Event
curl --location --request POST 'http://{DeviceServiceIP:Port}/api/v1/event'
Delete an Event
curl --location --request DELETE 'http://<IP_ADDRESS>:49986/api/v1/event/id/{EventID}"
Fixes # (issue)
Type of change

[X] New feature (non-breaking change which adds functionality)

How Has This Been Tested?

Run the Docker container for Edge-orchestration

docker run -it -d --privileged --network="host" --name edge-orchestration  -v /var/edge-orchestration/:/var/edge-orchestration/:rw -v /var/run/docker.sock:/var/run/docker.sock:rw -v /proc/:/process/:ro  lfedge/edge-home-orchestration-go:latest

Post an event by calling the API
curl --location --request POST 'http://<IP_ADDRESS>:49986/api/v1/event'
--header 'Content-Type: text/plain'
--data-raw '{
"device":"camera",
"readings":[{
"name":"cowcount",
"value":"9"
}]
}'
This will return an id of the event (In this example it returned 0d8d6738-5968-4b6c-92eb-1d45b2b3740a)

Call the delete API using
curl --location --request DELETE 'http://<IP_ADDRESS>:49986/api/v1/event/id/0d8d6738-5968-4b6c-92eb-1d45b2b3740a'

This will return true in case of success
Test Configuration:

OS type & version: (Ubuntu 20.04)
Hardware: (x86-64)
Edge Orchestration Release: (v1.1.0)

Checklist:

[X] My code follows the style guidelines of this project
[X] I have performed a self-review of my own code
[X] I have commented my code, particularly in hard-to-understand areas
[ ] I have made corresponding changes to the documentation
[ ] My changes generate no new warnings
[ ] I have added tests that prove my fix is effective or that my feature works
[X] New and existing unit tests pass locally with my changes

LGTM By the way, how to get the information inserted with add event API?

information of what? Addevent will return the id of the event inserted

2. {
"device":"camera",
"readings":[{
"name":"cowcount",
"value":"9"
}]
}

Input from service application such as { "device":"camera", "readings":[{ "name":"cowcount", "value":"9" }] }

LGTM By the way, how to get the information inserted with add event API?

information of what? Addevent will return the id of the event inserted

Input from service application such as { "device":"camera", "readings":[{ "name":"cowcount", "value":"9" }] }

This information can be obtained from database using the reading API or by calling the api in coredatabase to get all the events

Can a service application fetch the information through DataStroage REST API at the moment?

LGTM By the way, how to get the information inserted with add event API?

information of what? Addevent will return the id of the event inserted

Input from service application such as { "device":"camera", "readings":[{ "name":"cowcount", "value":"9" }] }

This information can be obtained from database using the reading API or by calling the api in coredatabase to get all the events

Can a service application fetch the information through DataStroage REST API at the moment?

Yes reading API

LGTM By the way, how to get the information inserted with add event API?

information of what? Addevent will return the id of the event inserted

Input from service application such as { "device":"camera", "readings":[{ "name":"cowcount", "value":"9" }] }

This information can be obtained from database using the reading API or by calling the api in coredatabase to get all the events

Can a service application fetch the information through DataStroage REST API at the moment?

For readings fetching Service application can call /api/v1/device/{deviceNameKey}/resource/{resourceNameKey} Get API
For event fetching no API exits as provided by homeedge


Added Turkish Localization

Description

Releated Issue

Checklist (for drafts):

[x] I read and understood the contributing guide as well as the code of conduct
[x] My changes generate no new warnings
[x] My code builds and runs on my machine
[ ] Review requested

Screenshots (if appropriate):

Added settings file and build


add lat/long choice to mapbox

The user should be able to enter a lat/long string like
-10.43542882,164.47188483

After looking at this, it doesn't look easy and might not be possible.

Don't think this is possible with Mapbox's Geocoding API, at least as provided with the plugin we're using at the moment.


FYI, libraries are only rated for Writing data. Read functions are empty

Had so much hope for this library, given so may Bluetooth projects for unity on iOS/Android are all paid only assets.
However, only the WRITE functions are implemented in the platform plugins.  All Read functions are empty.

hey Simon do you figured something out by now? I've had the same question but it seems like seiji isn't responding.

Sadly it seems this project is dead as I've not heard anything from @seiji
Apart from writing you're own plugin, there are no other open source projects supporting Unity @aurel471


code climate changes

Pull Request Test Coverage Report for Build 15

0 of 0   changed or added relevant lines in 0 files are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 100.0%

Totals

Change from base Build 13:
0.0%

Covered Lines:
19

Relevant Lines:
19

💛  - Coveralls


Build the test target only when master project

Changes to CMake build so that tests only run when NamedType is the master CMake project.

Thanks for the PR!


new bracket paring

Issue Type: Bug
The bracket guide does not match scope highlighting.
const initialVersion =
      selectedVersion || asset?.versions?.length > 0
        ? asset?.versions?.reduce((a, b) => {
            if (a.revisionKey >= b.revisionKey) {
              return a;
            }
            return b;
          })
        : null;

When you position the marker between the "}" and the ")" in the above code (2nd last line) then the new bracket matching does not match the scope highligthing which in my opinion is a bug. If you move the marker to after the ")" then it is correctly matching.
error:
correct:
VS Code version: Code 1.62.2 (3a6960b964327f0e3882ce18fcebd07ed191b316, 2021-11-11T20:56:38.428Z)
OS version: Windows_NT x64 10.0.19042
Restricted Mode: No

System Info

Item
Value

CPUs
Intel(R) Core(TM) i7-4980HQ CPU @ 2.80GHz (8 x 2794)

GPU Status
2d_canvas: enabledgpu_compositing: enabledmultiple_raster_threads: enabled_onoop_rasterization: enabledopengl: enabled_onrasterization: enabledskia_renderer: enabled_onvideo_decode: enabledvulkan: disabled_offwebgl: enabledwebgl2: enabled

Load (avg)
undefined

Memory (System)
15.91GB (7.29GB free)

Process Argv
--crash-reporter-id b8b1eef1-3f43-47cc-b1db-ed15deb2e5ff

Screen Reader
no

VM
0%

Extensions (17)

Extension
Author (truncated)
Version

npm-intellisense
chr
1.4.0

vscode-eslint
dba
2.2.2

githistory
don
0.6.19

gitlens
eam
11.6.1

prettier-vscode
esb
9.0.0

auto-rename-tag
for
0.1.9

vscode-pull-request-github
Git
0.32.0

go
gol
0.29.0

gc-excelviewer
Gra
3.0.44

vscode-graphql
Gra
0.3.18

vscode-styled-components
jpo
1.6.6

dotenv
mik
1.0.1

vscode-docker
ms-
1.17.0

csharp
ms-
1.23.16

remote-containers
ms-
0.205.2

debugger-for-chrome
msj
4.13.0

vscodeintellicode
Vis
1.2.14

Should be easy to fix.

Can someone tell me how should I enable scope highlighting, I am trying out this issue

Can someone tell me how should I enable scope highlighting, I am trying out this issue

Search for: editor.guides.bracketPairs in settings and set it to active

Fixed, though the old behavior was also not that bad.


NonEmptyList map gives me :: Seq<'b>

given a NonEmptyList<'a> and running that thru FSharpPlus.Operators.map I am getting a Seq<'b> where as I expected it to return a NonEmptyList<'b>. What am I doing wrong?
Only when I fully qualify the call to map like
NonEmptyList.map transform someNonEmptyList

the result is the correct type of functor

Probably because I don't see any Map instances for NonEmptyList in https://github.com/gmpl/FSharpPlus/blob/master/src/FSharpPlus/Functor.fs#L213 .
Can you add one and see if that works?

Sorry, I dont understand. What should I do exactly?

@mausch the instance is within the class
Although now the FsControl was merged we can put it in the Invokable, I have the impression that is good to keep the separation and only specify instances for primitive types in the Invokables.
@robkuz I think this issue was recently solved here but probably you are using the latest nuget which is previous to that fix.
The problem is that in some cases interfaces "eats" all instances before the instance declared in the type. This happens because F# does some automatically conversions (upcasts) in some situations.
So I did some workarounds to give either less priority to the interfaces overload, incases when it's still usable, or to reject compiling it unless it's explicitly upcasted as an interface, which is the case of the functor for NonEmptyList.
Try the latest code and let me know if it works in your scenario. I will see if I can upload a new nuget tonight.

Yes I am still using the old nuget

Here's the new nuget packege.
Let us know if it solves your issue.

Hi @robkuz I was wondering if you updated to the new nuget.
If you did it and it solved this issue, please close it.
Thanks !

Seems to work!


Openload Doing the Pigeon Dance Agsin

Just letting you know. Those pigeons are maddening. I was trying to view a HD file of the latest Making of the Mob and there they were 😫

This issue is fixed in Mrknow Urlresolver 2<IP_ADDRESS>
http://filmkodi.com/en/openload-fix/

It was for me for a while. It just started again. Is there something I need
to do? I know the URL resolver just recently updated. I'm not thoroughly
familar with Kodi yet. All I know is the fix you mention was good...for
awhile. Then so.ething must have happened but I don't know what.
On Aug 27, 2016 7:34 PM, "MrKnow"<EMAIL_ADDRESS>wrote:

This issue is fixed in Mrknow Urlresolver 2<IP_ADDRESS>
http://filmkodi.com/en/openload-fix/
—
You are receiving this because you authored the thread.
Reply to this email directly, view it on GitHub
https://github.com/mrknow/filmkodi/issues/449#issuecomment-242946781,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AUPc7DQOzXGMxIuHBnJAXLh4U1aSguOeks5qkMmAgaJpZM4Juu2R
.

@BankruptEd just restart your kodi

Po aktualizacji gołębie wróciły , "fix" nie pomógł - można to naprawić ?

Fixed in  version 2<IP_ADDRESS>. Update Mrknow URLResolver

Yes, thank you. You're awesome 😀
On Aug 28, 2016 1:15 PM, "MrKnow"<EMAIL_ADDRESS>wrote:

Fixed in version 2<IP_ADDRESS>. Update Mrknow URLResolver
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/mrknow/filmkodi/issues/449#issuecomment-242986591,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AUPc7IBISdP8Kt5vV-LhIPoS6Notd9K-ks5qkcIXgaJpZM4Juu2R
.

It didn't come through till a bit after your first reply but is good now.
On Aug 28, 2016 1:15 PM, "MrKnow"<EMAIL_ADDRESS>wrote:

Fixed in version 2<IP_ADDRESS>. Update Mrknow URLResolver
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/mrknow/filmkodi/issues/449#issuecomment-242986591,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AUPc7IBISdP8Kt5vV-LhIPoS6Notd9K-ks5qkcIXgaJpZM4Juu2R
.

And I will look closer at the date of the fix next time. I didn't clue in
to the 28 part of it, meaning today of course. I thought you were telling
me about an earlier fix. Thanks again.
On Aug 28, 2016 1:15 PM, "MrKnow"<EMAIL_ADDRESS>wrote:

Fixed in version 2<IP_ADDRESS>. Update Mrknow URLResolver
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/mrknow/filmkodi/issues/449#issuecomment-242986591,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AUPc7IBISdP8Kt5vV-LhIPoS6Notd9K-ks5qkcIXgaJpZM4Juu2R
.

Openload changed coding functions links video yesterday and today .
Version 2<IP_ADDRESS> solved the problem of yesterday's changes
Version 2<IP_ADDRESS> solves the problem of today's changes.
I wonder if tomorrow openload change anything ...

Ya I know what ya mean. Oh well, gotta roll with the punches. I'm just glad
someone is out there trying.
On Aug 28, 2016 3:14 PM, "MrKnow"<EMAIL_ADDRESS>wrote:

Openload changed coding functions links video yesterday and today .
Version 2<IP_ADDRESS> solved the problem of yesterday's changes
Version 2<IP_ADDRESS> solves the problem of today's changes.
I wonder if tomorrow openload change anything ...
—
You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/mrknow/filmkodi/issues/449#issuecomment-242993381,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AUPc7IUrezgmlfuAp22jtWMx1M6SoZcxks5qkd4LgaJpZM4Juu2R
.


Can't get animation to run when calling set state

I have been trying to get the animation to run when set state is called, but for some reason the animation only runs when the page is loaded.
myWidget.animate(target: _over ? 1 : 0).slideX(                   duration: 500.ms,                   begin: -1,                   end: 0,                 ),
The animate should slide the widget which is full screen from left to right.
I have searched everywhere for a working example of using the target, but the only code is in readme MyButton().animate(target: _over ? 1 : 0)   .fade(end: 0.8).scaleXY(end: 1.1)
and there is no working example I can run and try.
I can cheat by defining an controller and calling controller.forward(from: -1); but this seems to be overcomplicated.
Any help would be appreciated.

Here's a quick working example you can paste into playground_view.dart:
class PlaygroundView extends StatefulWidget {
  const PlaygroundView({Key? key}) : super(key: key);

  @override
  State<PlaygroundView> createState() => _PlaygroundViewState();
}

class _PlaygroundViewState extends State<PlaygroundView> {
  bool _val = false;

  @override
  Widget build(BuildContext context) {
    return Column(
      children: [
        const Text("Playground 🛝")
            .animate(target: _val ? 1 : 0)
            .slideY()
            .fadeIn(),
        IconButton(
          onPressed: () => setState(() => _val = !_val),
          icon: const Icon(Icons.arrow_circle_right, color: Colors.white),
        ),
      ],
    );
  }
}

Many thanks, the example works but how can I get it to always slide in, at the moment it will slide in when set state is called, but then slide out when set state is called again. I just want to it always begin at -1 and slide in.


Can't shoot right as client

The client can shoot but it always shoot in the direction of the tank instead of where it needs to be shot.

It happens because tank's head isn't synchronized over the network


Remove project name support in v2

We currently have support for two different "names" with identical default values in the user config:
default.project.name=${init_archetype}-${init_flavor}
default.artifact.id=${init_archetype}-${init_flavor}

The project name is only important for the generated directory name.
The issue is that when in interactive mode with helidon init, it is easy to change one value and not the other, resulting in behavior that violates the principle of least surprise. For example, using "foo" as the project name and accepting the default for artifact id will create a directory name "foo" but the artifact id, jar name, docker image name, etc. will all be based on the default.
Removing support for project name is the cleanest way of avoiding this issue:

Use  the artifcactId value for the directory name
Add a warning if --name is supplied saying that it will be unused
Add a comment in the generated user config saying that default.project.name is only used for v1

ArchetypeEngineV2.generate() must be updated to use artifactId for the output directory.
IntegrationTestMojo.processIntegrationTest() must be updated to stop adding the name.


HDDS-2940. mkdir : create key table entries for intermediate directories in the path

What changes were proposed in this pull request?
for MKDIR operation - add separate directory entry in OM key table for each directory that appears in the path passed to mkdir.
What is the link to the Apache JIRA
https://issues.apache.org/jira/browse/HDDS-2940
How was this patch tested?
unit tests.
TestOzoneFileInterfaces#testDirectory is modified to assert that prefix directories get created.

Regarding fixing object ID logic in
OMKeyRenameRequest#validateAndUpdateCache
Not sure why object id should get updated during a rename. that would not be correct for an inode number in a filesystem.  Ozone FS should not be any different either. What about object semantics? In the code, I do not see object id manipulation.
The addAcl() and setAcl() in PrefixManagerImpl, I could not find references to object id getting set/updated here. Can you please clarify what needs to be done there.

Not sure why object id should get updated during a rename. that would not be correct for an inode number in a filesystem. Ozone FS should not be any different either. What about object semantics? In the code, I do not see object id manipulation.
Sure. Will file a Jira to fix this separately.

The addAcl() and setAcl() in PrefixManagerImpl, I could not find references to object id getting set/updated here. Can you please clarify what needs to be done there.
In PrefixManagerImpl lines 318 and 368 we set the objectID. Are you rebased with the latest master? These changes went in as part of HDDS-2962.

Setting the object id in addAcl/setAcl inside PrefixManagerImpl, requires a separate discussion. Discussing with @arp7, it looked like we would end up with separate object ids for the same prefix - one in the prefix table and another in the key table. That would be a problem.
Is this understanding correct? If so, I would want to defer the fix from the current patch. Pl give your opinion. Any other blocking comments?

@supratimdeka , sure we can fix the Prefix ACL ObjectID in a separate Jira.
I am +1 for merge pending CI.

CI is successful with the latest patch. Request to merge, this will unblock HDDS-2941.


Overriding hoisted variables

I would like to have your opinions on the behaviour we should support when overriding a hoisted variables.
Codepen example: http://codepen.io/cbchouinard/pen/OPggJb
Since I'm explicitly overriding the varY variable within the .large-box ruleset, I personally would find it more intuitive if later reference to that variable within the same scope and reference to the variable from nested scope would use the override variable and not the original one.
In other words, I would expect the height of .inner-box to have a constraint of 130px and not 65px since varY was override in its parent scope. I would also expect the .large-box height to be equal to 130px since I override the value within that scope.
 varY == 65;

 .container {

   .small-box {
     varX: == 200;
     width: == varX;
     height: == varY;
     center-x: == ::window[center-x];
   }

   .large-box {
     &varY == 130;
     varX: == 400;
     width: == varX;
     height: == varY;
     center-x: == ::window[center-x];

     .inner-box {
       height: == varY;
     }

   }

The strange thing is that if I do:
.inner-box {
        height: == ^varY;
      }

then the height of .inner-box will be of 130px. Since we're saying that hoisting is traversing the parent' scopes to search for a variable, it is a bit confusing that we don't get the value of the direct parent of .inner-box.

Currently explicitly scoped variables like &varY dont "capture" nested hoisted variables. If we do otherwise, then using variables with the same name as css property will hoist a lot.
e.g.
width == 200;
.large-box {
   width: == width; // won't work, evalutes to &width == &width
}

Basically, when you explicitly use scope like &varY it's a "property". When you don't, it's "variable".

Could we prevent declaring variable with the same names as CSS properties?

CCSS parser doesnt know about css properties. It's a tradeoff to keep things simple. More than that we're planning to have custom css things too.

I think we're saying that we need a mechanism to prevent hoisting to allow things like this:
.container {
  font-size: == 16;

  .featured {
    font-size: == 20;

    .heading {
      font-size: == 24;
    }
  }
}

in which case, we'd just use &font-size: ==  in all places instead of font-size: == ?

I think we have consensus that current hoisting rules are quite predictable. font-size: == is equal to &font-size == and will not cause hoisting for this variable, since it has explicit scope.


Precompution phase

Hi @Bren2010,
I read the code that you wrote for Chow. I have a question there. As I understood from the Chow scheme in key generation phase, the application should create a table for every section and precompute everything on that table. for example, the Tbox step should be defined as out = TBox(in) instead of out = SBox(RelativeByteOfRoundKey ^ in). It means that TBox should be completely similar to the sbox table. In other words, generate all possibility of 'in' and calculate relative 'out' and store these pair as a table. So that in the encryption phase, the application search in the table based on input and finding the output. But in your application, I saw that you are calculating based on SBox(RelativeByteOfRoundKey ^ in) in the encryption phase. could you please explain?

Can you point to which area of the code you're specifically confused about? The encryption logic here looks reasonable to me -- everything is computed as table lookups.

in the section that you pointed you are calling ExpandWord. Then the program tries to call the Get method of TBoxTyiTable. So it refers to the Get method of common.TBox as this type assigned to the TBoxTyiTable in the key generation phase. So the this Get method will be called. This get method does "SBox(RelativeByteOfRoundKey ^ in)", not retrieve from precompiled table.

Ah ok, you're right that after key generation TBoxTyiTable will be backed by an implementation that still has the round key in memory. However if you serialize and then parse the construction, you'll see that the table is computed in-full and then backed by an opaque table.ParsedWord. Hope that helps!


ImageDreamfusion accumulate grad, guidance_eval in sd,if

Accumulates grad in imagedreamfusion
Fixes imagedreamfusion to accumulate grads from ref and guidance

Adds guidance_eval to stable_diffusion, deep_floyd
Adds the ability to optionally evaluate guidance periodically, in stable_diffusion and deep_floyd (as done in zero123)

This does not affect current working of stable_diffusion, deep_floyd, it only adds the option to visualize the guidance.
Example
I used the following command to check the results with stable diffusion guidance:
python launch.py --config configs/experimental/imagecondition.yaml --train --gpu 0 system.freq.ref_only_steps=20 system.freq.guidance_eval=13
To run with deep floyd guidance, I uncommented the requisite lines in configs/experimental/imagecondition.yaml.
First, since ref_only_steps=20, it should run with just rgb_loss for 20 iterations.
Then, from 21st iteration, it should also compute guidance loss.
Then, since freq.guidance_eval=13, at the 26th iteration, it should save the results of guidance_eval:
With stable-diffusion:

With deep-floyd:

@bennyguo this introduces redundancies but I think it's a good short-term step... so unless you have a concern, we'd like to merge it today.
Later I recommend we fold some of the loss calculation/logging code in the base system class and maybe fold some of the eval guidance logic in the base guidance class, to avoid unnecessary code duplication. How does that sound?

I've folded guidance_eval_save into base.py, and address the comments. Please check!

Tested!
Merging with main


Automated Detection and Extraction of Deployment Components of Docker Services

Find and extract components and their relations from crawled dockerfiles

Start and end date: 2018-11-09 to 2019-05-09
Supervisor: Lukas Harzenetter, @lharzenetter

Crawler for GitHub working
Components from Dockerfiles can be extracted for following commands: apt-get, pip3 (no -r for pip3)

[x] Ensure that you followed http://eclipse.github.io/winery/dev/ToolChain#github---prepare-pull-request.
[x] Branch name checked. That means, the branch name starts with thesis/, fix/, ...
[x] Ensure that the commit message is a good commit message
[x] Ensure to use auto format in all files
[x] Ensure that you appear in NOTICE at Copyright Holders
[x] Tests created for changes
[x] Documentation updated (if needed)
[x] Screenshots added (for UI changes)

https://github.com/eclipse/winery/pull/412


Fine Tuning - SQuAD 2.0 on GPU 8 GB

I've been fine tuning the original xlnet model to run on a 8 GB GPU (RTX 2080).
The modifications make possible to fine tuning the model on SQuAD 2.0 dataset achieving 86.25 F1-Score
Here's the forked repo with the changes: https://github.com/renatoviolin/xlnet

Nice results! Just added a pointer to your repo.

@renatoviolin , I went through the updated files, could you tell me where/how you freezed the layers: 1~11? Thnx!

@shawei3000
In this file https://github.com/renatoviolin/xlnet/blob/master/model_utils_GPU.py
line 142:  variables = variables[-177:]
I get all trainable vars, and re-assign only the last 177 vars. The print() on following lines outputs all the trainable variables so that you can see exactly which they are.
For example, if you want to train one more layer, ie, 11, 12, ..., you need to specify
variables = variables[-190:]
Each layer has 13 trainable variables, so each 13 will step down / up the layers.

Hi @renatoviolin, how to activate FP16 training for your modified code?

Hi @yangapku In this file https://github.com/renatoviolin/xlnet/blob/master/model_utils_GPU.py , lines 147 - 166 is the code to use FP-16. It is already hard-coded as TRUE in the line 147.

@renatoviolin
Thank you very much! A further question please~ If I changed the settings of training and warmup steps in the config, should I change the params of tf.contrib.mixed_precision.ExponentialUpdateLossScaleManager (in line 150) accordingly?

@yangapku I don't did it yet. In my tests I keep these parameters unchanged to keep track of the improvements I could do in the network without modify the parameters that the XLNet was trained.
Those parameters at line 150 is not related with the ones defined at FLAGS. I adopted those lines from a NVidia implementation of FP16.
Let me know If you achieve better results with another params values.

Hi @renatoviolin, it seems the modification of FP16 is not compatible with multi-GPU setting? The following error occurs (platform TF1.12, CUDNN v7, CUDA 9):
Traceback (most recent call last):
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/python/training/coordinator.py", line 297, in stop_on_exception
yield
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/contrib/distribute/python/mirrored_strategy.py", line 177, in _call_for_each_tower
**merge_kwargs)
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/python/training/optimizer.py", line 665, in _distributed_apply
self._create_slots(var_list)
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/python/training/adam.py", line 125, in _create_slots
first_var = min(var_list, key=lambda x: x.name)
ValueError: min() arg is an empty sequence
Traceback (most recent call last):
File "src/run_squad.py", line 1322, in <module>
tf.app.run()
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/python/platform/app.py", line 125, in run
_sys.exit(main(argv))
File "src/run_squad.py", line 1219, in main
estimator.train(input_fn=train_input_fn, max_steps=FLAGS.train_steps)
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/python/estimator/estimator.py", line 354, in train
loss = self._train_model(input_fn, hooks, saving_listeners)
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/python/estimator/estimator.py", line 1205, in _train_model
return self._train_model_distributed(input_fn, hooks, saving_listeners)
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/python/estimator/estimator.py", line 1316, in _train_model_distributed
self.config)
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/python/training/distribute.py", line 721, in call_for_each_tower
return self._call_for_each_tower(fn, *args, **kwargs)
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/contrib/distribute/python/mirrored_strategy.py", line 556, in _call_for_each_tower
return _call_for_each_tower(self, fn, *args, **kwargs)
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/contrib/distribute/python/mirrored_strategy.py", line 183, in _call_for_each_tower
coord.join(threads)
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/python/training/coordinator.py", line 389, in join
six.reraise(*self._exc_info_to_raise)
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/python/training/coordinator.py", line 297, in stop_on_exception
yield
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/contrib/distribute/python/mirrored_strategy.py", line 177, in _call_for_each_tower
**merge_kwargs)
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/python/training/optimizer.py", line 665, in _distributed_apply
self._create_slots(var_list)
File "/home/slurm/job/tmp/job-110471/xdevel-tf1.12-cuda-9.0-cudnn7.4-trt5/lib/python2.7/site-packages/tensorflow/python/training/adam.py", line 125, in _create_slots
first_var = min(var_list, key=lambda x: x.name)
ValueError: min() arg is an empty sequence

Hi @yangapku I'm using a single RTX 2080 CUDA 10, CUDNN 7.5, Python 3.7, TF 1.13.1
I don't have experience with multi-gpu.
I could take a look at https://github.com/horovod/horovod. It seems this implementation support FP16 and multi-gpu.

Hi, I download your code and try to test it on my PC. I download Squad2.0 dataset ,and run the prepro_squad.sh and get the result file 'spiece.model.0.slen-512.qlen-64.train.tf_record' . Where should I put this result file?  When I try to run 'gpu_squad_base_GPU.sh', I got an error message
ValueError: Tensor conversion requested dtype string for Tensor with dtype float32: 'Tensor("arg0:0", shape=(), dtype=float32, device=/device:CPU:0 '
Are there any wrong operation make error happens?   Are there other path or config need to be modified?

Hi @renatoviolin, when I run the script,   got the error like this
line 222, in get_qa_outputs     xlnet_config = xlnet.XLNetConfig(json_path=FLAGS.model_config_path) AttributeError: module 'xlnet' has no attribute 'XLNetConfig',
I didn't change any code of this file ,  are there something wrong？

Hi @MaXXXXfeng, have you used the original code before?
It seems that you have problems with the paths for the files.
Check the script gpu_squad_base_GPU.sh for the path variables. Adjust them according to your paths.
local path
SQUAD_DIR=data/squad
INIT_CKPT_DIR=xlnet_cased_L-24_H-1024_A-16
PROC_DATA_DIR=proc_data/squad
MODEL_DIR=experiment/squad
Suppose your root directory is /home/user

Create the folder "/home/user/xlnet" to download all the python files and the scripts folder.
Create the folder "/home/user/data/squad" make sure to have these fles "dev-v2.0.json" and "train-v2.0.json" and "evaluate-v2.0.py"
Create the folder "/home/user/proc_data/squad"  this folder will be used to save the tf.data files during preprocessing squad json files.
INIT_CKPT_DIR must point to xlnet pretrained model
MODEL_DIR must point to somewhere you want save the checkpoints during fine tuning.

I execute the scripts from the folder /home/user/xlnet
$ bash scripts/gpu_squad_base_GPU.sh

Hi @MaXXXXfeng, have you used the original code before?
It seems that you have problems with the paths for the files.
Check the script gpu_squad_base_GPU.sh for the path variables. Adjust them according to your paths.
local path
SQUAD_DIR=data/squad
INIT_CKPT_DIR=xlnet_cased_L-24_H-1024_A-16
PROC_DATA_DIR=proc_data/squad
MODEL_DIR=experiment/squad

Suppose your root directory is /home/user

Create the folder "/home/user/xlnet" to download all the python files and the scripts folder.
Create the folder "/home/user/data/squad" make sure to have these fles "dev-v2.0.json" and "train-v2.0.json" and "evaluate-v2.0.py"
Create the folder "/home/user/proc_data/squad"  this folder will be used to save the tf.data files during preprocessing squad json files.
INIT_CKPT_DIR must point to xlnet pretrained model
MODEL_DIR must point to somewhere you want save the checkpoints during fine tuning.

I execute the scripts from the folder /home/user/xlnet
$ bash scripts/gpu_squad_base_GPU.sh

Thanks for your reply, it't very helpful. The reason I thought might because of the GPU since I run same code on 2080, it works. Another tips is when we create tf_record, we need to modify the max_seq_length to 340 instead of 512。

Hi, @MaXXXXfeng good point about max_seq_length.
Any time we change the max_seq_length we have do delete all files of "PROC_DATA_DIR" so that they are recreated with the right length.

Hi, @renatoviolin  , i tried your code and got the below results
Result
best_exact 50.08001347595385 |
best_exact_thresh -1.2460410594940186 |
best_f1 50.08001347595385 |
best_f1_thresh -1.2460410594940186 |
has_ans_exact 0.08282726045883941 |
has_ans_f1 0.11427438585200644 |
Running on a 16GB P100 . Not sure what i am missing. Please suggest if you have any clues.
thanks
Hari

Hi @harirajeev
Sometimes I got results like yours (but I don't remember what I did to solve, because I did so many things).
Here is my code folderthat I train for 90000 iterations and got the following results:
best_f1 86.33
To train, run the scripts/_train.sh (note that you need to adjust the paths.)
Let me know if it helped.
Renato

Hi @harirajeev
Sometimes I got results like yours (but I don't remember what I did to solve, because I did so many things).
Here is my simplified code folder that I train for 90000 iterations and got the following results:
best_f1 86.33
To train, run the scripts/_train.sh (note that you need to adjust the paths.)
Here is the model pre-trained. Download
Let me know if it helped.
Renato

Thank you so much @renatoviolin  ,
Were you using use_bfloat16 as True for training ?.
thanks
Hari

Hi Hari,
No, use_bfloat16 = False (line 59, file run_squad_3.py).
I use float16 directly in the code (lines 147-150, file model_utils_3.py).
I think bfloat is specific for TPU usage.
Regards
Renato
On Sun, Aug 4, 2019 at 2:25 AM harirajeev<EMAIL_ADDRESS>wrote:

Hi @harirajeev https://github.com/harirajeev
Sometimes I got results like yours (but I don't remember what I did to
solve, because I did so many things).
Here is my simplified code folder
https://drive.google.com/file/d/1d_XM-mQFIQRlQMO50Io6u6UDRfbABYEi/view?usp=sharing
that I train for 90000 iterations and got the following results:
best_f1 86.33
To train, run the scripts/_train.sh (note that you need to adjust the
paths.)
Here is the model pre-trained. Download
https://drive.google.com/open?id=11g7yvyqhmuzvDukiT-Fe4gNid4pcr-vc
Let me know if it helped.
Renato
Thank you so much @renatoviolin https://github.com/renatoviolin ,
Were you using use_bfloat16 as True for training ?.
thanks
Hari
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/zihangdai/xlnet/issues/64?email_source=notifications&email_token=ACD4J6W6MMHDXD5S74VQJ5LQCZR4PA5CNFSM4H3XEINKYY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOD3P2XLI#issuecomment-517974957,
or mute the thread
https://github.com/notifications/unsubscribe-auth/ACD4J6UOOJBFL47ONAGOJ63QCZR4PANCNFSM4H3XEINA
.

Thank you @renatoviolin , got the below results
====== RESULT ========
best_exact 83.39088688621241
best_exact_thresh -3.2638230323791504
best_f1 86.23878272238977
best_f1_thresh -2.422508955001831
has_ans_exact 0.8621794871794872
has_ans_f1 0.9295812035245823

Hi @renatoviolin  , have you tried your model to infer on data outside the squad dataset ?. How was the result like.
Thanks
Hari

Hi @harirajeev
I tried to fine tune BERT on Trivia-QA, but didn't got good results in that case.
With XLNET I haven't tried it yet.

Hi, @renatoviolin , thanks for your code. Its very helpful. i tried to rerun using your code and got the below results
Result
best_exact 50.08001347595385 |
best_exact_thresh -1.2460410594940186 |
best_f1 50.08001347595385 |
best_f1_thresh -1.2460410594940186 |
has_ans_exact 0.08282726045883941 |
has_ans_f1 0.11427438585200644 |
Running on a 16GB P100 . Not sure what i am missing. Could your please suggest if you have any clues.
thanks
Hari

Hi Hari,
I am also getting the same results when I re-run the code.  Could you share about how you fixed the problem.
Thanks,
Cibin

Hi @harirajeev
Sometimes I got results like yours (but I don't remember what I did to solve, because I did so many things).
Here is my simplified code folder that I train for 90000 iterations and got the following results:
best_f1 86.33
To train, run the scripts/_train.sh (note that you need to adjust the paths.)
Here is the model pre-trained. Download
Let me know if it helped.
Renato

Hey there! Really helpful code and explanations of various issues that might come up! I just wanted to know whether the model link you've attached here is the one you got F1 as 86.33?


Point CircleCI to this repo

Signed-off-by: Gábor Lipták<EMAIL_ADDRESS>

@Sean-Holcomb please review

Hi @gliptak thanks so much for this PR. I think the repo we actually want to point to is quay.io/kubecost1/kubecost-cost-model:latest Mind making that change?

@AjayTripathy anything else on this PR?

Hi gliptak! thanks for following up, it is much appreciated. I still need to change the keys on our side.


Revisit gRPC BBEs and support testing them in distribution build

Description:
Current BBE modules need to revisit and incorporate with the new changes.

As a subtask, we need a better way to pass this(https://github.com/ballerina-platform/ballerina-distribution/commit/4af483997d546e843b1d8c51b23099ca04d205fc) keystore and truststore file to the gRPC service and client.

As a subtask, we need a better way to pass this(https://github.com/ballerina-platform/ballerina-distribution/commit/4af483997d546e843b1d8c51b23099ca04d205fc) keystore and truststore file to the gRPC service and client.

This is supported now, hence closing the issue


Visualization script has no goal

Hi,
Thanks for the release of these environments that help significantly with different experimental setups. I am currently trying to use the visualization script, and I notice that the goal is not being displayed in the goal location (the red ball, for example, in the maze envs). Is there a fix to this?

Update: This can be done by calling set_target()

Hello,
Did it really work for you?
I am trying to play the trajectories but the target is out of the maze?
goals = dataset['infos/goal']
for t in range(100);
env.set_state(qpos[t], qvel[t])
env.set_target(goals[t])
env.render()
Any help is appreciated.

okay, I have to call step() even for visualization.


Exception triggered by signal '1' while running grsiproof

While running GenericSelector code on sorted data grsiproof started failing, the specific command ran was: grsiproof analysis11496
_000.root ~/packages/GRSISort/GRSIProof/GenericSelector.C --max-workers=4
The issue printed was:
0.0: caught exception triggered by signal '1' while processing dset:'TDSet:AnalysisTree', file:'/data1/griffin/S1626/analysis/analysis11496_000.root' - check logs for possible stacktrace - last event: 0
Info in TProofLite::MarkBad:
+++ Message from master at grsmid01.triumf.ca : marking grsmid01.triumf.ca:-1 (0.0) as bad
+++ Reason: undefined message in TProof::CollectInputFrom(...)
the log file is attached for one of the 4 workers
worker-0.0-grsmid01.triumf.ca-1529780193-19657.log

There is a file in the directory where you run with a name like "grsiproof.log" It will have the entire output including the master. Can you attach that the next time it crashes?

Usually I find this is one or a combination of the following:
-Referring to a branch in the analysis tree that doesn't exist (test with "if(fZDS)" for example)
-Looping over the wrong thing (e.g. "i" instead of "j") or referring to a channel that doesn't exist.
-Mismatch between a defined histogram and the histogram that is filled, or filling a histogram that doesn't exist.

Vinzenz has been working on the exception throwing in grsiproof, some of which tell you how you failed. I don’t think the standard proof logs would necessarily print those errors, but the log file I reference will print some of them. Those are all very good suggestions though.

We have isolated the issue to PACES. once the detector was turned on all runs after failed with the selector code. When we comment out the section of the selector with Paces hits it runs correctly. We have attached the selector code so if one of you could take a look and see if you recognize the issue in the selector code please let us know. We are still working on getting the grsiproof.log file.

This is a GenericSelector in .txt format as i could not attach the .C version
GenericSelector.txt

I suspect this is the way PACES is numbered. I was using this selector to sort older data from last year where the PACES numbering scheme ranges from 0-4. The range is currently 1-5.

Change pdet to pdet-1

That should do it. Also the non-linearity correction starting here:
for (int j = 0; j < dp; j++){ 	   xtmp.push_back (pxNL[pdet][j]); ytmp.push_back (pyNL[pdet][j]); 	}
can probably be removed for data taken with the Rev2 modules anyway.

Thanks guys, It is now up running. Mike shall I remove the line you mention?

Probably best to remove it and just use GetEnergy() without any additional corrections.

Also, in the future, it helps to use vectors and the .at(index) access. If you go beyond the range of the vector, a very obvious exception is thrown instead of a run-of-the-mill seg fault.


Add Rust implementations of FilterParser and Matcher

These don't replace the C++ implementations because we still have to compare them — unit tests alone aren't enough.
Most of this code is by @tsipinakis; he submitted it in #701. I made a lot of small edits on top, and history became an absolutely incomprehensible mess, so I created a new one instead. I still managed to split it in somewhat logically-isolated portions, so it's entirely possible to review commit-by-commit.
See #621.

This is ready for review now. Since it a sizeable chunk of code, I'll wait a week before merging it.

Coverage increased (+1.8%) to 56.645% when pulling cc27877fb6598fa48adde0af515d73bff56f4ee5 on feature/rust-filterparser-and-matcher into 6dd942a27f0bb71d0979b9b713e331b941a366b3 on master.

Thanks! I squashed the fixup now.

Thank you for the review, @dennisschagt!


[Test] add test for helicity angles

there is a nice method of computing the helicity angles in the packages already.
Is it properly tested?
We can implement a test that validates it using an example from Lc->pKpi,
three different chains:

Kpi ((2,3),1),
pK ((1,2),3), and
pip ((3,1),2).

The helicity angles are given below,
    "chain_variables": {
        "Kpi": {
            "mkpisq": 1.3743747462964881,
            "theta_Kst": 1.0468159811504423,
            "phi_Kst": 1.3921357860994747,
            "theta_K": 1.692234518478623,
            "phi_K": 0.5466265769529981
        },
        "pK": {
            "mkpsq": 2.756020646168232,
            "theta_L": 2.6621627135924624,
            "phi_L": 3.010596711405015,
            "Ltheta_p": 1.861461784272743,
            "Lphi_p": 1.3499280354237881
        },
        "pip": {
            "mppisq": 2.2410542593352796,
            "theta_D": 1.05685191949046,
            "phi_D": -1.1654157065810633,
            "theta_pi": 1.1669778470524175,
            "phi_pi": 2.5984404692152796
        }

sadly, I did not save the four-vectors, but one reconstruct them by building aligned kinematics, and rotating it back to, e.g.
(in a separate notebook, just to find the four-vectors for input of the test)

build align kinematics, from here
using the Kpi reference orientation (Pp = [0,0,-lambda...,Ep])
Rotate aligned four-vectors with

Rz(phi_Kphi)*Ry(theta_Kst)*Rz(phi_K)

The test would be to get all four angles right for every topology.

up on the issue! Let's proceed on it,
it will help us to make the tests in
https://github.com/mmikhasenko/Traversing-Decay-Tree/issues/2
Not sure it belongs to decayangle tests. It can be added to
https://github.com/mmikhasenko/Traversing-Decay-Tree repository with the dependence on decayangle.

I think both places would be fine.
I just didnt tackle this yet, since it is simple enough on the surface, but promises to be one of these problems, where you mess up one step in the calculation of the four momenta and spend too much time debugging.
I will try to get it done withing the next days.

I've found one instance implementing the three-body aligned kinematics
https://github.com/ComPWA/polarimetry/blob/main/julia/notebooks/eulerangles.jl#L84-L95
used these zeta=hat(theta) angles from DPD

https://github.com/KaiHabermann/decayangle/pull/32


Enforce proposal ordering in the ProposalQueue

Fixes #251.

Refactor the ProposalQueue s.t. the iterator returned by filtered_by_type iterates over the Proposals contained in the queue in order of their insertion into the queue.
Add a test for both constructors that tests this.

As I mentioned OOB, the ProposalQueue could do with some refactoring. This PR is solely focused on having the iterator returned by filtered_by_type iterate over the ProposalQueue in order of the Proposal's insertion.


Fix agent api invokation issue

What problem does this PR solve?
#3570
Type of change

[x] Bug Fix (non-breaking change which fixes an issue)

How long will it take to fix it, can you teach us how to deal with it, or do we need to wait until the upgrade

sorry ,  I have got , thanks

I encountered a problem when running the same code as #3570. May I ask how to solve this problem? My problem is as follows:
Traceback (most recent call last):
File "/workspace/myragflow/test.py", line 15, in
for ans in session.ask(question, stream=True):
File "/root/anaconda3/envs/ragflow/lib/python3.12/site-packages/ragflow_sdk/modules/session.py", line 34, in ask
reference = json_data["data"]["reference"]
~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^
KeyError: 'reference'

I encountered a problem when running the same code as #3570. May I ask how to solve this problem? My problem is as follows: Traceback (most recent call last): File "/workspace/myragflow/test.py", line 15, in for ans in session.ask(question, stream=True): File "/root/anaconda3/envs/ragflow/lib/python3.12/site-packages/ragflow_sdk/modules/session.py", line 34, in ask reference = json_data["data"]["reference"] ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ KeyError: 'reference'

see our solve at https://github.com/infiniflow/ragflow/issues/3570#issuecomment-2550171714,  However, we also can not  completely solved the problem either.


Function applications with parenthesis and one multiline application

Hello,
In the section Formatting constructors, static members, and member invocations all examples seem to have multiple arguments. What happens is there is only a single long (multiline) argument wrapped in parenthesis?
let poemBuilder = StringBuilder()
poemBuilder.AppendLine("""
The last train is nearly due
The Underground is closing soon
And in the dark, deserted station
Restless in anticipation
A man waits in the shadows
""")

Option.traverse(
    create
    >> Result.setError [ invalidHeader "Content-Checksum" ]
)

does the
functionName (
    arg // indented
)

shape remain? Or should it change to
functionName
    (arg) // indented

Next I have another related question: do the same rules for constructors, static members and member invocations also apply to regular functions that take a single tuple parameter?
let myFunction (a: int, b: string, c: int, d: bool) =
    ()

myFunction (
    478815516,
    "A very long string making all of this multi-line",
    1515,
    false
)

From a more technical point of view these are all just function calls (SynExpr.App (someIdent, Paren(Tuple()))).
So I would expect the same formatting, though the style guide does not really specify this.

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: 8c09996f-24ac-cf39-ef43-d7909cbc2b89
Version Independent ID: 1efdd523-8552-6421-e149-74f76826ef8f
Content: F# code formatting guidelines
Content Source: docs/fsharp/style-guide/formatting.md
Product: dotnet-fsharp
GitHub Login: @cartermp
Microsoft Alias: phcart

Great question!
I generally think that the same shape should remain, and this should also apply to tupled arguments for a long tuple as a single arg. I'd happily accept a PR that clarifies this.


Update grid with bootstrap like classes for small and medium devices

This PR relates to issue #210. I used the grid that was in this branch as the base, and added two additional grid systems to it one for small/mobile devices and one for medium/tablet devices. The original grid is still there and functions the same.

Any plans on adding this?

I agree, this is a massive help for smaller screens.

I have added mobile grids to my Version of Skeleton also a navbar and more colors. Check it out
http://github.com/oltmannsdaniel/skeleton-plus

@benhinchley  I just forked it to keep Skeleton alive. There are 48 outstanding PRs and none of the files have been updated in 2 years.
Please feel free to come to mine and do a PR. I'm going to start maintaining it and looking for people to help me too. Are you interested? If not, just ping me your PR and I'll test and push it out within 48 hours.
Take care @benhinchley

I recently forked skeleton and added classes to allow show and hide of content. Just like Foundation and bootstrap. It's called skeleton_display [(https://github.com/codecobber/Skeleton-display]). you can also see a demo on my github pages [https://codecobber.github.io/skeleton_display.html]


fix: Correct Fargate profiles additional IAM role policies default type to match variable

Description

Correct Fargate profiles additional IAM role policies default type to match variable

Motivation and Context

Closes #2136
Closes #2142

Breaking Changes

No

How Has This Been Tested?

[ ] I have updated at least one of the examples/* to demonstrate and validate my change(s)
[x] I have tested and validated these changes using one or more of the provided examples/* projects

[x] I have executed pre-commit run -a on my pull request

This PR is included in version 18.26.3 :tada:


cogclock: Support Bangle.js 2

Very tight, but I think it looks acceptable with hidden widgets:

(I thought about defaulting the widget setting to "swipe", but figured it would add too much clutter.)

Looks great, thanks! Is it possible to take the change to core out of the PR though?

Thanks!


ERROR: IDELAYE2 'IDELAYE2' has disconnected IDATAIN input

I am struggling to understand what's happening here:
$ gdb --args $NEXTPNR_DIR/nextpnr-xilinx -v --chipdb $NEXTPNR_DIR/xilinx/xc7a35t.bin --xdc arty.xdc --json arty.json --write top_routed.json --fasm arty.fasm --debug
(gdb) b log_error
Breakpoint 1 at 0x798c0: file /home/fallen/dev/nextpnr-xilinx/common/log.cc, line 164.
(gdb) run
Starting program: /home/fallen/dev/nextpnr-xilinx/nextpnr-xilinx -v --chipdb /home/fallen/dev/nextpnr-xilinx//xilinx/xc7a35t.bin --xdc arty.xdc --json arty.json --write top_routed.json --fasm arty.fasm --debug
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".

Info: Inserting IO buffers..

Info: Packing constants..

Breakpoint 1, nextpnr_xilinx::log_error (
    format=format@entry=0x5555556f6ab8 "%s '%s' has disconnected IDATAIN input\n")
    at /home/fallen/dev/nextpnr-xilinx/common/log.cc:164
164	{
(gdb) bt
#0  nextpnr_xilinx::log_error (
    format=format@entry=0x5555556f6ab8 "%s '%s' has disconnected IDATAIN input\n")
    at /home/fallen/dev/nextpnr-xilinx/common/log.cc:164
#1  0x00005555556c4b5d in nextpnr_xilinx::XC7Packer::pack_iologic (
    this=this@entry=0x7fffffffd130)
    at /home/fallen/dev/nextpnr-xilinx/common/nextpnr.h:715
#2  0x0000555555692382 in nextpnr_xilinx::Arch::pack (this=0x55555cab5c90)
    at /home/fallen/dev/nextpnr-xilinx/xilinx/pack.cc:914
#3  0x00005555555bb764 in nextpnr_xilinx::CommandHandler::executeMain (
    this=0x7fffffffd9d0, ctx=std::unique_ptr<nextpnr_xilinx::Context> = {...})
    at /usr/include/c++/9/bits/unique_ptr.h:360
#4  0x00005555555bd90f in nextpnr_xilinx::CommandHandler::exec (this=0x7fffffffd9d0)
    at /usr/include/c++/9/bits/move.h:74
#5  0x00005555555b1fa9 in main (argc=<optimized out>, argv=<optimized out>)
    at /home/fallen/dev/nextpnr-xilinx/xilinx/main.cc:88
(gdb) up
#1  0x00005555556c4b5d in nextpnr_xilinx::XC7Packer::pack_iologic (
    this=this@entry=0x7fffffffd130)
    at /home/fallen/dev/nextpnr-xilinx/common/nextpnr.h:715
715	    template <typename T> const char *nameOf(const T *obj) const

(gdb) p *ci
$3 = {<nextpnr_xilinx::ArchCellInfo> = {{lutInfo = {is_memory = false,
        is_srl = false, input_count = 0, output_count = 0, memory_group = 0,
        only_drives_carry = false, input_sigs = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0},
        output_sigs = {0x0, 0x0}, address_msb = {0x0, 0x0, 0x0}, di1_net = 0x0,
        di2_net = 0x0, wclk = 0x0}, ffInfo = {is_latch = false, is_clkinv = false,
        is_srinv = false, ffsync = false, is_paired = false, clk = 0x0, sr = 0x0,
        ce = 0x0, d = 0x0}, carryInfo = {out_sigs = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0,
          0x0, 0x0}, cout_sigs = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0},
        x_sigs = {0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0}}, muxInfo = {sel = 0x0,
        out = 0x0}}}, name = {index = 145}, type = {index = 145}, udata = 0,
  ports = std::unordered_map with 6 elements = {[{index = 31884}] = {name = {
        index = 31884}, net = 0x55555dcd1b10, type = nextpnr_xilinx::PORT_IN,
      tmg_id = {index = -1}}, [{index = 31214}] = {name = {index = 31214},
      net = 0x55555dcd1b10, type = nextpnr_xilinx::PORT_IN, tmg_id = {index = -1}},
    [{index = 31883}] = {name = {index = 31883}, net = 0x55555e38dd30,
      type = nextpnr_xilinx::PORT_IN, tmg_id = {index = -1}}, [{index = 31211}] = {
      name = {index = 31211}, net = 0x55555fff5ea0, type = nextpnr_xilinx::PORT_IN,
      tmg_id = {index = -1}}, [{index = 31885}] = {name = {index = 31885},
      net = 0x55555dcd1b10, type = nextpnr_xilinx::PORT_IN, tmg_id = {index = -1}},
    [{index = 31209}] = {name = {index = 31209}, net = 0x55555f0ad180,
      type = nextpnr_xilinx::PORT_OUT, tmg_id = {index = -1}}},
  attrs = std::unordered_map with 2 elements = {[{index = 46453}] = {
      is_string = true, str = "arty.v:11051", intval =<PHONE_NUMBER>}, [{
      index = 62351}] = {is_string = false, str = "1", '0' <repeats 31 times>,
      intval = 1}}, params = std::unordered_map with 8 elements = {[{
      index = 93442}] = {is_string = true, str = "DATA", intval =<PHONE_NUMBER>}, [{
      index = 93441}] = {is_string = true, str = "200.000000",
      intval =<PHONE_NUMBER>}, [{index = 93440}] = {is_string = true, str = "FALSE",
      intval =<PHONE_NUMBER>}, [{index = 93439}] = {is_string = false,
      str = "0001", '0' <repeats 28 times>, intval = 8}, [{index = 93438}] = {
      is_string = true, str = "FIXED", intval =<PHONE_NUMBER>}, [{index = 93437}] = {
      is_string = true, str = "TRUE", intval =<PHONE_NUMBER>}, [{index = 93436}] = {
      is_string = true, str = "IDATAIN", intval =<PHONE_NUMBER>}, [{index = 93435}] = {
      is_string = true, str = "FALSE", intval =<PHONE_NUMBER>}}, bel = {tile = -1,
    index = -1}, belStrength = nextpnr_xilinx::STRENGTH_NONE,
  pins = std::unordered_map with 0 elements, constr_parent = 0x0,
  constr_children = std::vector of length 0, capacity 0, UNCONSTR = -2147483648,
  constr_x = -2147483648, constr_y = -2147483648, constr_z = -2147483648,
  constr_abs_z = false, region = 0x0, tmg_id = {index = -1}}
(gdb) c
Continuing.
ERROR: IDELAYE2 'IDELAYE2' has disconnected IDATAIN input
0 warnings, 1 error
[Inferior 1 (process 320818) exited with code 0377]

Here is arty.v:11051
11051 IDELAYE2 #(
11052         .CINVCTRL_SEL("FALSE"),
11053         .DELAY_SRC("IDATAIN"),
11054         .HIGH_PERFORMANCE_MODE("TRUE"),
11055         .IDELAY_TYPE("FIXED"),
11056         .IDELAY_VALUE(4'd8),
11057         .PIPE_SEL("FALSE"),
11058         .REFCLK_FREQUENCY(200.0),
11059         .SIGNAL_PATTERN("DATA")
11060 ) IDELAYE2 (
11061         .IDATAIN(blinkysoc_a7ddrphy_dqs_i[0]),
11062         .LD(blinkysoc_a7ddrphy_rst_storage),
11063         .DATAOUT(blinkysoc_a7ddrphy_dqs_i_delayed[0])
11064 );
11065
11066 IOBUFDS IOBUFDS(
11067         .I(blinkysoc_a7ddrphy_dqs_o_no_delay0),
11068         .T(blinkysoc_a7ddrphy_dqs_t0),
11069         .IO(ddram_dqs_p[0]),
11070         .IOB(ddram_dqs_n[0]),
11071         .O(blinkysoc_a7ddrphy_dqs_i[0])
11072 );

also extract from arty.json:
        "blinkysoc_a7ddrphy_dqs_i": {
          "hide_name": 0,
          "bits": [ 14522, 14523 ],
          "attributes": {
            "src": "arty.v:393"
          }
        },
[...]

       "IDELAYE2": {
          "hide_name": 0,
          "type": "IDELAYE2",
          "parameters": {
            "CINVCTRL_SEL": "FALSE",
            "DELAY_SRC": "IDATAIN",
            "HIGH_PERFORMANCE_MODE": "TRUE",
            "IDELAY_TYPE": "FIXED",
            "IDELAY_VALUE": 8,
            "PIPE_SEL": "FALSE",
            "REFCLK_FREQUENCY": "200.000000",
            "SIGNAL_PATTERN": "DATA"
          },
          "attributes": {
            "module_not_derived": 1,
            "src": "arty.v:11051"
          },
          "port_directions": {
            "DATAOUT": "output",
            "IDATAIN": "input",
            "LD": "input"
          },
          "connections": {
            "DATAOUT": [ 13042 ],
            "IDATAIN": [ 14522 ],
            "LD": [ 3145 ]
          }
        },

I'm attaching the files: issue.zip
Any idea?
Thanks!

It seems this port gets disconnected by this piece of code:
(gdb) bt
#0  0x00005555555cafad in nextpnr_xilinx::disconnect_port (ctx=<optimized out>,
    cell=0x55556000b430, port_name=...)
    at /home/fallen/dev/nextpnr-xilinx/common/design_utils.cc:118
#1  0x000055555568456a in nextpnr_xilinx::XilinxPacker::flush_cells (
    this=this@entry=0x7fffffffd130) at /usr/include/c++/9/bits/unique_ptr.h:360
#2  0x00005555556c68aa in nextpnr_xilinx::XC7Packer::pack_io (
    this=this@entry=0x7fffffffd130)
    at /home/fallen/dev/nextpnr-xilinx/xilinx/pack_io_xc7.cc:277
#3  0x000055555569237a in nextpnr_xilinx::Arch::pack (this=0x55555cab5c90)
    at /home/fallen/dev/nextpnr-xilinx/xilinx/pack.cc:910
#4  0x00005555555bb774 in nextpnr_xilinx::CommandHandler::executeMain (
    this=0x7fffffffd9d0, ctx=std::unique_ptr<nextpnr_xilinx::Context> = {...})
    at /usr/include/c++/9/bits/unique_ptr.h:360
#5  0x00005555555bd91f in nextpnr_xilinx::CommandHandler::exec (this=0x7fffffffd9d0)
    at /usr/include/c++/9/bits/move.h:74
#6  0x00005555555b1fb9 in main (argc=<optimized out>, argv=<optimized out>)
    at /home/fallen/dev/nextpnr-xilinx/xilinx/main.cc:88

Don't hesitate to ask me to add any more detail on the issue.
I can also give a try to some patch! :+1:

Sorry, this got forgotten about. Its a familiar error, I will look into the detail tomorrow.

Thanks a lot! :)

Trying the json provided, I get
ERROR: Found an out-of-range integer parameter in the JSON file.
Please regenerate the input file with an up-to-date version of yosys.

are you sure that your yosys and nextpnr-xilinx are up to date?

I'm on

Yosys release 0.9 (sha-1 1979e0b1f2482dbf0562f5116ab444280a377773)

But I think I was on an older nextpnr-xiling sha-1 .... I've just rebased on origin/xilinx-upstream
let me retry this.

You will need to use Yosys from git master, not the last release.

I can confirm that with up to date nextpnr-xilinx I get the same error as you.
So I need to use master branch of Yosys?

Just saw your answer, thanks! Will try that.

With up to date Yosys master branch build, I now get this error:
Info:     Created 3 DSP48E1_DSP48E1 cells from:
Info:              3x DSP48E1
ERROR: Clocked DSP48E1s are currently unsupported (while processing cell $flatten\lm32_cpu.\multiplier.$mul$/home/fallen/.local/lib/python3.6/site-packages/misoc-0.6.dev0-py3.6.egg/misoc/cores/lm32/verilog/submodule/rtl/lm32_multiplier.v:115$4898.sliceA.last.sliceB[0].mul, clocked by blinkysoc_clkout_buf0).
0 warnings, 1 error

the json file: arty.json.zip
The json is generated via:
attrmap -tocase keep -imap keep="true" keep=1 -imap keep="false" keep=0 -remove keep=0
synth_xilinx -flatten -arch xc7 -top arty
write_json arty.json

Try adding scratchpad -set xilinx_dsp.multonly 1 to the yosys script before synth_xilinx

It worked!
Thanks!
What is it doing?

That disables use of the DSP registers and other fancy features by Yosys - at the time I did the DSP support in nextpnr-xilinx prjxray only had limited DSP support, although things may have improved since then.

Thanks a lot!
Closing this ticket :)


Camera  some time get wrong position

In Mixed reality portal camera always get right rotation and distance from floor but in app when scene is begining Camera don't get right distance from floor.
(Microsoft Mixed Reality Headset)

I note it recently happen when I see that headset lost tracking (not bounds displayed).
And @designnomad right, switching back to Cliffhouse works well.
To fix this issue do one of the point below:

Move head side-to-side, sometime in 10-15 seconds problem disappear.
Restart Mixed Reality Portal.

Thanks for answers. Maybe anyone know is It

hardware problem?
SDK problem
My wrong code

Think the problem somewhere in the MRTK.
The best solution in case there is no boundary or elevation data to get some default average value of 1.6-1.8 meters.

I don't know where in code camera is getting its position. But as far i know it is impossible to set position to camera.transform it can be possible only for camera parent.
Most offten this problem appear if headset  place on table(for example) in begining of scene. But sometimes  problem can be too even if headset on head.

Which version of Unity are you using? This sounds like a Unity issue, since the camera's position (other than moving the camera parent for teleporting) and the alignment of the coordinate space are both handled by the platform/Unity, not by the Toolkit.

Unity 2017.3.0f3
Also have some issue with the camera height.
Image you have a floor and a 1m height box, your camera at 1.8m.
You teleport from the floor to the box (camera height 2.8) then back to the floor and sometime camera height stay at 2m or 2.5m.
I.e. after teleport on some different height the camera elevation does not return at origin value.

keveleigh,
Unity 2017.3.0f3 and in Unity 2017.2.0p1-MRTP4  this problem was. I mean if I set camera position in LateUpdate  camera position doesn't change.
But problem in another. Camera some times after scene starts still placing on floor and doesn't jump to right position from floor. And sometimes together with this problem also controllers  not spawned

Unity 2017.3.1 released today but I did not found any information about this issue
https://unity3d.com/unity/whats-new/unity-2017.3.1

Just tested and camera positioning issue exists on Unity 2017.3.1

@warzoku

I mean if I set camera position in LateUpdate camera position doesn't change.

That's right. Unity overrides any change to the camera based on the user's head movement. That's why we use the camera parent object to move the camera around.
All of the camera issues sound like Unity bugs, where they aren't properly moving the coordinate space.

Sent bug report to Unity
Case 1001658

Got response from Unity team.
They have been able to reproduce this issue and have sent it to developers for resolution.

Untiy [Universal Windows Platform] Platform does not support.
The Socket code is written and the Thread code is written and the FileStream code is written, you know what?
I used the network communication section to find that this part of the code could not be transferred to the [Universal Windows Platform].
After I tested Unity 2017.2.0f3 (64-bit) version,Unity 2017.3.1f1 (64-bit) version,Unity 2017.2.1f1 (64-bit) version.
They don't support it.
Do you have any feedback on untiy?
When I wrote socket and IO and Thread related code in the program, untiy packaging times was wrong,
The socket.Connect function is not supported.
The socket.Receive function is not supported, and the
socket.Send function is not supported.
The filestream.close function is not supported,
New Thread(recv) is not supported,
Does not support Thread. IsBackground,
Does not support Thread. To Start,
But if I just write in the code.
The Socket client = null;
Thread the Thread = null;
FileStream filedata = null;
This way, the Universal Windows Platform is passed.
I think it should be the flaw in the Platform library of untiy [Universal Windows Platform].
Please help me to feedback this question,
------------------ 原始邮件 ------------------
发件人<EMAIL_ADDRESS>发送时间: 2018年3月2日(星期五) 凌晨2:17
收件人<EMAIL_ADDRESS>抄送<EMAIL_ADDRESS>主题: Re: [Microsoft/MixedRealityToolkit-Unity] Camera some time get wrongposition (#1646)
Got response from Unity team.
They have been able to reproduce this issue and have sent it to developers for resolution.
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.

This issue is still reproducible with Unity 2019.2.6f1.


Refactor OS specific Makefile to directory

Pull requests:

https://github.com/Senzing/template-go/pull/112


doc: refurbish doc site

Problem statement
Our documentation site, https://goswagger.io is powered by the venerable gitbook .
Here are a few impediments with go-swagger documententation:

The look and feel hasn't improved in years.
The build is not automated
There isn't much control over the layout, menus, etc.
There is no incentive to improve docs (e.g. direct editiing pages, with faster CI path...)
The documentation structure has grown and is now rather confusing
As a consequence, content & accuracy degrade over time

Proposal
I've been working on a prototype to produce a revamped documentation site.
You may see it in action on my active fork (still some rough edges, as there is some WIP on content): https://fredbi.github.io/go-swagger/
What's on the table?

doc site built with hugo, using theme "hugo-book"

Why HUGO?
The contemplated alternative is Jeckyll, which comes with a better integration with github.
At this point, the choice is: "going full github, tick all the boxes" vs "using a widespread alterative, with more control over the published content".

Why hugo-book?
After some time researching and experimenting various templates, this one was standing out (IMHO)
as the one with easiest configuration and closest rendering to what I wanted (with an overall organization
similar to the one produced by gitbook).  It worked almost out of the box, with little customization that I could
add later on (e.g. tabs, collapsible sections, etc).
Lately  I've also tried "docsy" (a rich template by google/netlify), but I found it a bit complex.
It also came with strong opinions about how to document a project. Although these ideas are good,
they needed an even deeper restructuing of our markdown material.

markdown content now use "frontmatter" headers

Tried to add minimal frontmatter, with maximum reliance on the theme.

doc layout changed to accomodate how hugo builds a site hierarchy

used a few "shortcodes" from the theme for a more compelling UI (e.g. tabs, collapsible sections, ...)

link to edit the page (creates a new PR with the page)

doc site built from github actions at every push to master (see https://github.com/fredbi/go-swagger/blob/master/.github/workflows/update-doc.yaml)

github pages are deployed using the "gh-pages" artifact.

What's still missing?
There is still quite some work ahead, though.

a complete review of the content: we need to recap, check for accuracy, provide more examples, etc.  _ that would be for later_
publish docs for multiple versions (I've built a small prototype for that part as well, but it's still incomplete)
not sure how the custom domain on top of github.com/go-swagger.github.io would behave with the new artifact-based deployment
a separate CI fast lane for doc-only PRs (again, prototype to illustrate this here: https://github.com/fredbi/analysis/pull/1)

@casualjim @youyuanwu  how about that?

looks good to me. the DNS name should be fine but old external links will stop working

@casualjim thanks mate. I yet have to figure out a solution to put several releases online. I am glad you endorsed the idea


Introduce decorators

Hi, we already has the zmq.Context and zmq.Socket act as a context manager, but there is deep indentation when we use both. So we can use decorator for function to make the code beautiful.

context
socket

For example.
import zmq
from zmq.decorators import context, socket

@context()
@socket(zmq.PUB)
def f(skt, ctx):
    skt.bind('...')
    ...

For more usage, there are test cases in this PR.
Also, i'm willing to change variables naming, coding style, or making more documentation, if that make everyone comfortable to merge this PR.  :smile:

Can you give an example (and test) of what this looks like to use two or more sockets, and the socket decorator without the context decorator?

Hi @minrk !
Test cases for multi sockets added in ebe337d

BTW, any design for zmq.proxy? It seems this is more complex case to design...

err.. I have no idea why ci failed..

More tries about mock.patch.
I figure out that mock.patch does f(otherargs, [mocked_args in backward ...], kwargs)
In [71]: @patch('os.path.isdir')
   ....: @patch('os.path.join')
   ....: def f(mock, join, isdir, fake=None):
   ....:     print(mock)
   ....:     print(join)
   ....:     print(isdir)
   ....:     print(fake)

In [72]: f('foo')
foo
<MagicMock name='join' id='34545165088'>
<MagicMock name='isdir' id='34543901272'>
None

In [73]: f('foo', 'bar')
foo
bar
<MagicMock name='join' id='34543967480'>
<MagicMock name='isdir' id='34543964960'>

In [74]: f('foo', fake='bar')
foo
<MagicMock name='join' id='34556771576'>
<MagicMock name='isdir' id='34556771744'>
bar

Then.
I tried to make the pattern f([forward_args...], other_args, kwargs).
The Implementation became mush complex; it also brakes class method to pass self and let functools.partial fail.
So finally, i chose the pattern -- f(other_args, [forward_args...], kwargs).
Please try the latest patch out. :)

If you would prefer to follow mock's pattern exactly, that would be fine with me, since there's a popular library to point to for precedence.
There appear to be intermittent failures due to something funky in the threaded tests.

Oh. Before you highlighted the precedence, i never notice that injecting args in backward (like mock does) is so non-intuitive for most user. Maybe i should put alway my 'preconception'.
And the latest implementation is forward, it's intuitive to use, so i will vote for forward version.
which one do your vote for?

forward: f(other_args, [args in forward...], kwargs)
backward: (mock.patch-like): f(other_args, [args in backward...], kwargs)

About the threaded testing:
When i wrote the feature code, i do not take care the thread safety. And i hope the related problem solved in  6d18c4f. Please review my code, and i can explain them if you need.

Forward makes more sense to me. Thanks!

:tada: I will write some documentation and send them later


failed to initialize Terragrunt configuration in

I have a root terragrunt.hcl that contain my remote configuration.I have 2 environments which are “prod-env and dev-env” in each of the folder i have a child terragrunt that use "Include" to point to the path of the root terragrunt.hcl.I just tried to run my workflow and I dont understand the error am getting.This is the error I’m getting:
Successfully moved Terragrunt v0.31.4
30init: info: initializing Terragrunt configuration in ./dev-env
31init: error: failed to initialize Terragrunt configuration in ./dev-env
32time=2021-08-16T18:01:09Z level=error msg=Error reading file at path /github/workspace/terragrunt.hcl: open /github/workspace/terragrunt.hcl: no such file or directory
33time=2021-08-16T18:01:09Z level=error msg=Unable to determine underlying exit code, so Terragrunt will exit with error code 1
each of my child terragrunt.hcl contain
include {
path = find_in_parent_folder()
}

Hard to help without more info. Could you please share:

Your complete terragrunt.hcl.
The exact command you're running.
The full log output.

Please use fenced code blocks to make it more readable too. Thanks!

root terragrunt.hcl
'''remote_state {
    backend = "s3"

    config = {
        bucket   = fileexists(local.overrides_path) ? lower(format("%s-tfstate", join("-", values(local.overridden)))) : join("-", [ lower(local.team),lower(local.environment),lower(local.aws_region), "tfstate", ])
        key      = "${path_relative_to_include()}/terraform.tfstate"
        region   = "us-east-1"
        encrypt  = true
        dynamodb_table = "gitactionlock-table"
    }
}

generate "backend" {
path = "backend.tf"
if_exists = "overwrite_terragrunt"
contents = <<EOF
terraform {
backend "s3" {
bucket         = fileexists(local.overrides_path) ? lower(format("%s-tfstate", join("-", values(local.overridden)))) : join("-", [ lower(local.team),lower(local.environment),lower(local.aws_region), "tfstate", ])
key            = "${path_relative_to_include()}/terraform.tfstate"
region         = "us-east-1"
encrypt        = true
dynamodb_table = "gitactionlock-table"
}
}
EOF
}
locals {
team   = "dev-env143"
environment = "test-gitaction"
aws_region = "us-east-1"
overrides_path = "${get_terragrunt_dir()}/overrides.yaml"
overrides = yamldecode(fileexists(local.overrides_path) ? file(local.overrides_path) : "{}")
overridden = fileexists(local.overrides_path) ? (local.overrides.base_s3) : {}
}
terraform {
extra_arguments "reconfigure" {
commands = ["init"]
arguments = ["-reconfigure"]
}
}

1...root terragrunt
'''remote_state {
backend = "s3"
    config = {
        bucket   = fileexists(local.overrides_path) ? lower(format("%s-tfstate", join("-", values(local.overridden)))) : join("-", [ lower(local.team),lower(local.environment),lower(local.aws_region), "tfstate", ])
        key      = "${path_relative_to_include()}/terraform.tfstate"
        region   = "us-east-1"
        encrypt  = true
        dynamodb_table = "gitactionlock-table"
    }
}

'''generate "backend" {
path = "backend.tf"
if_exists = "overwrite_terragrunt"
contents = <<EOF
terraform {
backend "s3" {
bucket         = fileexists(local.overrides_path) ? lower(format("%s-tfstate", join("-", values(local.overridden)))) : join("-", [ lower(local.team),lower(local.environment),lower(local.aws_region), "tfstate", ])
key            = "${path_relative_to_include()}/terraform.tfstate"
region         = "us-east-1"
encrypt        = true
dynamodb_table = "gitactionlock-table"
}
}
EOF
}
'''
'''locals {
team   = "dev-env143"
environment = "test-gitaction"
aws_region = "us-east-1"
overrides_path = "${get_terragrunt_dir()}/overrides.yaml"
overrides = yamldecode(fileexists(local.overrides_path) ? file(local.overrides_path) : "{}")
overridden = fileexists(local.overrides_path) ? (local.overrides.base_s3) : {}
}
'''
'''terraform {
extra_arguments "reconfigure" {
commands = ["init"]
arguments = ["-reconfigure"]
}
}
'''
2... I'm running Terragrunt subcommand using GithubActions
3... full log output.
'''
Checking the latest version of Terraform
Downloading Terraform v1.0.5
Successfully downloaded Terraform v1.0.5
Unzipping Terraform v1.0.5
Successfully unzipped Terraform v1.0.5
Checking the latest version of Terragrunt
Downloading Terragrunt v0.31.5
Successfully downloaded Terragrunt v0.31.5
Moving Terragrunt v0.31.5 to PATH
Successfully moved Terragrunt v0.31.5
init: info: initializing Terragrunt configuration in ./Stage/dev-env
init: error: failed to initialize Terragrunt configuration in ./Stage/dev-env
Remote state S3 bucket dev-env143-test-gitaction-us-east-1-tfstate does not exist or you don't have permissions to access it. Would you like Terragrunt to create it? (y/n) time=2021-08-19T15:11:09Z level=error msg=EOF
time=2021-08-19T15:11:09Z level=error msg=Unable to determine underlying exit code, so Terragrunt will exit with error code 1
'''

Child Terragrunt.hcl
'''
include {
path = find_in_parent_folders()
}

@drey0143143 , have you found a solution?

@KumeshUTS I've not been able to fix it yet


⚠ Bofrost.lu has degraded performance

In e83942a, Bofrost.lu (https://www.bofrost.lu) experienced degraded performance:

HTTP code: 200
Response time: 1034 ms

Resolved: Bofrost.lu performance has improved in af306e2 after 8 minutes.


styling with sytled components

what is the best way to style Table with Styled Components?

Hello! 😄
For this type of question, I suggest using Stack Overflow with a #react-virtualized tag or asking in the react-virtualized Slack channel. Issues are reserved for bug reports and feature-requests.
This helps keep the project somewhat more maintainable for me and hopefully gets you an answer faster (since more people check those places than monitor GitHub issues). 😄


merykitty gave in to Unsafe

Check List:

[x] Tests pass (./test.sh <username> shows no differences between expected and actual outputs)
[x] All formatting changes by the build are committed
[ ] Your launch script is named calculate_average_<username>.sh (make sure to match casing of your GH user name) and is executable
[x] Output matches that of calculate_average_baseline.sh

Execution time of merykittyunsafe:

 Performance counter stats for 'sh calculate_average_merykittyunsafe.sh':

          13497.35 msec task-clock:u              #   10.750 CPUs utilized
                 0      context-switches:u        #    0.000 /sec
                 0      cpu-migrations:u          #    0.000 /sec
            227100      page-faults:u             #   16.826 K/sec
<PHONE_NUMBER>0      cycles:u                  #    4.519 GHz
         289560740      stalled-cycles-frontend:u #    0.47% frontend cycles idle
         114022556      stalled-cycles-backend:u  #    0.19% backend cycles idle
<PHONE_NUMBER>02      instructions:u            #    1.87  insn per cycle
                                                  #    0.00  stalled cycles per insn
<PHONE_NUMBER>9      branches:u                #  945.553 M/sec
          53292216      branch-misses:u           #    0.42% of all branches

       1.255587212 seconds time elapsed

      12.568676000 seconds user
       0.870567000 seconds sys

Execution time of merykitty:

 Performance counter stats for 'sh calculate_average_merykitty.sh':

          15482.62 msec task-clock:u              #   11.502 CPUs utilized
                 0      context-switches:u        #    0.000 /sec
                 0      cpu-migrations:u          #    0.000 /sec
            222547      page-faults:u             #   14.374 K/sec
<PHONE_NUMBER>1      cycles:u                  #    4.586 GHz
         362493890      stalled-cycles-frontend:u #    0.51% frontend cycles idle
         130886807      stalled-cycles-backend:u  #    0.18% backend cycles idle
<PHONE_NUMBER>86      instructions:u            #    2.02  insn per cycle
                                                  #    0.00  stalled cycles per insn
<PHONE_NUMBER>3      branches:u                #    1.506 G/sec
          45042342      branch-misses:u           #    0.19% of all branches

       1.346125882 seconds time elapsed

      14.487117000 seconds user
       0.916624000 seconds sys

Not sure if this is allowed, I have consciously avoided using Unsafe, and this is my attempt to truly push the challenge to its limit.

The code consistently outpaces the solutions of Thomas and Roy in C2, but I don't think it will do so after taking into consideration AOT vs JIT and after staring at the assembly for 3 hours I have not come up with any ideas.

@merykitty How much slower does it perform with aot?

@artsiomkorzun It is about 8 times slower with Graal, I do not have a Graal built with hsdis at hand but looking at the code comments:
  0x00007fadf73244c8: ; ImmutableOopMap {rax=Oop r10=Oop r11=Oop [16]=Oop [24]=Oop }
                      ;*iinc {reexecute=1 rethrow=0 return_oop=0}
                      ; - (reexecute) jdk.incubator.vector.ByteVector::ldLongOp@35 (line 368)
                      ; - jdk.incubator.vector.ByteVector$ByteSpecies::ldLongOp@8 (line 4262)
                      ; - jdk.incubator.vector.ByteVector::lambda$fromMemorySegment0Template$105@8 (line 3811)
                      ; - jdk.incubator.vector.ByteVector$$Lambda/0x00007fad9c05e900::load@10
                      ; - jdk.internal.vm.vector.VectorSupport::load@32 (line 428)
                      ; - jdk.internal.misc.ScopedMemoryAccess::loadFromMemorySegmentScopedInternal@28 (line 361)
                      ; - jdk.internal.misc.ScopedMemoryAccess::loadFromMemorySegment@31 (line 338)
                      ; - jdk.incubator.vector.ByteVector::fromMemorySegment0Template@33 (line 3807)
                      ; - jdk.incubator.vector.Byte256Vector::fromMemorySegment0@3 (line 938)
                      ; - jdk.incubator.vector.ByteVector::fromMemorySegment@31 (line 3297)
                      ; - dev.morling.onebrc.CalculateAverage_merykittyunsafe::iterate@37 (line 256)

I assume that jdk.internal.vm.vector.VectorSupport::load is not intrinsified properly, some more other vector intrinsics seem to express the same behaviour.

@merykitty Yes, we are aware of this issue with the Vector API. Unfortunately it still changes quite often when in incubator phase and it is difficult for us to keep up with the intrinsifications, which for this kind of low-level compiler API are essential.

It doesn't seems to be a clear improvement on the eval machine for some reason. Here's the results from 10 runs:
Benchmark 1: timeout -v 300 ./calculate_average_merykitty.sh 2>&1
  Time (mean ± σ):      3.268 s ±  0.127 s    [User: 21.568 s, System: 0.741 s]
  Range (min … max):    2.953 s …  3.430 s    10 runs

Summary
  merykitty: trimmed mean 3.286730414775, raw times 3.1829055004,2.9527902024,3.3237153764,3.3429483424,3.2571899574,3.4296059994,3.2995724264,3.2947934074000003,3.3001821494000003,3.2925361584000004

Leaderboard

| # | Result (m:s.ms) | Implementation     | JDK | Submitter     | Notes     |
|---|-----------------|--------------------|-----|---------------|-----------|
|   | 00:03.286 | [link](https://github.com/gunnarmorling/1brc/blob/main/src/main/java/dev/morling/onebrc/CalculateAverage_merykitty.java)| 21.0.1-open | [Quan Anh Mai](https://github.com/merykitty) |  |

@gunnarmorling It is a separate entry merykittyunsafe instead of merykitty. I don't really want to add Unsafe to my original submission so can this go as a separate entry? Thanks.

@gunnarmorling It is a separate entry merykittyunsafe instead of merykitty.

Ah, sorry, had missed that. Oh, boy 🤯 :
Benchmark 1: timeout -v 300 ./calculate_average_merykittyunsafe.sh 2>&1
  Time (mean ± σ):      2.573 s ±  0.024 s    [User: 15.982 s, System: 0.749 s]
  Range (min … max):    2.521 s …  2.605 s    10 runs

Summary
  merykittyunsafe: trimmed mean 2.575439155045, raw times 2.57165876642,2.57405251042,2.55458195942,2.5576553414200003,2.52133204842,2.5802883164200003,2.59440042542,2.58838683042,2.60452826242,2.58248909042

Leaderboard

| # | Result (m:s.ms) | Implementation     | JDK | Submitter     | Notes     |
|---|-----------------|--------------------|-----|---------------|-----------|
|   | 00:02.575 | [link](https://github.com/gunnarmorling/1brc/blob/main/src/main/java/dev/morling/onebrc/CalculateAverage_merykittyunsafe.java)| 21.0.1-open | [merykittyunsafe](https://github.com/merykittyunsafe) |  |

I don't really want to add Unsafe to my original submission so can this go as a separate entry? Thanks.

Yes, we can do that. While there should be only one entry per participant by default, I am happy to make an exception for this case.

@gunnarmorling Wow that is really impressive, I guess the test machine is much more capable at utilising the reduction in instruction count than mine. Thanks a lot for your help.

@merykitty Really cool vectorized solution!
On my machine utilizing all CPU cores the solution becomes memory-bound, but I think given that the evaluation is done only on 8 cores out of the 64, the reduction in instructions is giving the speed-up.

Strangely enough, both merykitty and merykittyunsafe are very slow on the old Hetzner CCX33. 45 and 40 seconds, respectively (on the official dataset). On the same instance, royvanrijn is at 4.7 seconds. I know the new instance doesn't have AVX-512 support, either, so I wonder what should explain this.

@mtopolnik that's why, in some extent I personally prefer SWAR, when applicable, cause it works the same across archs, although it add some register pressure. Peak performance is obvious not comparable...

@mtopolnik Are you running with C2 or with Graal? Because the latter has not caught up with the development of the Vector API yet.

Yes, @mtopolnik the numbers there seem to indicate you were running with Graal JIT with the missing intrinsifications for the incubator Vector API.

Didn't btw know about "-Djdk.incubator.vector.VECTOR_ACCESS_OOB_CHECK=0" yet. Is this planned to stay and be the new unsafe ;-) ?

@mtopolnik Are you running with C2 or with Graal? Because the latter has not caught up with the development of the Vector API yet.

Oops, I have a script that calls prepare_author.sh and then calculate_average_author.sh. But now I see there's no prepare_merykitty*.sh.


Login requirements in API blueprint don't work

All data can be accessed without authentication via API.

The code that protects the API is: https://github.com/miguelgrinberg/flasky/blob/master/app/api_1_0/authentication.py#L35-L37.
Are you saying this code isn't running, for some reason?

Yes, @auth.login_required decorator don`t reject anonymous requests to API.
for example: /api/v1.0/posts/ return full list of blog posts whenever you are logged in or not.

Blog posts in this app are public. Try sending a POST request to add a blog post, and let me know if that goes through. Pretty sure that will fail.

I thought that blog posts are not public because of this test:
class APITestCase(unittest.TestCase):
...
def test_no_auth(self):
    response = self.client.get(url_for('api.get_posts'), content_type='application/json')
    self.assertTrue(response.status_code == 401)

Unauthorised POST request surely fails because of using another decorator  @permission_required(Permission.WRITE_ARTICLES)

I think you are looking at an old version of this test, I vaguely remember fixing this a while ago. The current version of this test expects a 200: https://github.com/miguelgrinberg/flasky/blob/master/tests/test_api.py#L40-L43.

Got it. Thank you for the reply.


Invert ticks

Chart.js allows for inverting ticks via the 'reverse' option:
ticks: {
    reverse: true
}

This option does not work with LinearGauge. Is it possible? If yes, any help would be greatly appreciated.

Solved by reversing the scale range. Note: if using custom tick values then the scaleLabel must also use custom values.


Make sure all tests pass for Python 3.7 >

Currently,

test_torsion_matching will fail in Python 3.7 because TypeError: cannot make approximate comparisons to non-numeric values: None on Line 27
test_zmatrix will fail because the positions of the atoms change between versions (probably an rdkit/etkdg issue).

python >= 3.11 now expected.
Tests were passing with version prior to this change that required Python >= 3.9.


Verification policies from Walt.Id may leak into Nessus

PR: https://github.com/walt-id/waltid-ssikit/pull/214

Done


Add to cart functionality

🎇 Description
pls assign me this issue
🖼 Screenshots
No response

assign me this issue

see above message I've already asked to assign me


pkg/admission: validate GatewayClass updates

What type of PR is this?

/kind feature
What this PR does / why we need it:
This patch introduces validation for updates to GatewayClass resources.
Which issue(s) this PR fixes:

Fixes #189
Does this PR introduce a user-facing change?:

Immutability of `spec.controller` field in GatewayClass resource is now enforced using the validation webhook.

/cc @robscott @stevesloka @jpeach

lgtm!


Part 3: the constructino of the Instruction Table

Thank you very much with this excellent guides about zkVM. I am a little confused about the description about a permutation argument (for a subset relation) as shown in the figure. Actually,  a permutation argument should be used for the multi-set equality?
Another question is:
In the Instruction Table (IT) section, it says that the Instruction Table contains one row for every row in the Processor Table (PT), in addition to one row for every instruction in the program. Assume an instruction not in the program is included in the Processor Table, then this instruction will still be included in the Instruction Table. Then, the subset relation between PT and IT  and sublist relation program and IT will be satisfied. In this way, it seems the soundness is broken.
Actually, I think an easier understanding way could be used to prove that each instruction executed in the Processor Table is belongs to the Program. As follows,

An Instruction Table with three colums (ip, ci, ni) could be publicly constructed based on the Program (ip, ci). The first two colums of the Instruction Table are exactly the same with the two colums of Program. The third colum satisfy the constrain that ci = ni', which means that ci is the same with the next instruction.
Use a lookup argument to prove that each row of the related colums in the Processor Table belongs to the Instruction Table.

In regards to the first question: Part I / Other Relations describes how you can turn a permutation argument for multiset equality into one for subset containment. The trick is to condition the accumulator-update on a bit in a new indicator column.
In regards to the second question, the relevant sentence is this:

The evaluation argument accumulates a term in every row that follows a change in ip, and remains the same in every row that does not.

Specifically, pea undergoes one update for each pair of distinct consecutive rows in the Instruction Table. If the Instruction Table has a row that is not present in the Program Table, then this update cannot be replicated on the side of the Program Table, and the evaluation argument check won't pass.
Your solution works as well. The challenge is to ensure that the indicator column, which tells the permutation argument how often to accumulate the factor associated with a given row in the Instruction Table, does not leak any information about the concrete execution trace. You can make the entire table secret, but then we are back at my solution where we need an evaluation argument to establish that it as generated correctly from some program. But it's fine if you make part of the table public and part secret.


update to v6.4

Closes #8.

Checklist

[x] Used a personal fork of the feedstock to propose changes
[ ] Bumped the build number (if the version is unchanged)
[x] Reset the build number to 0 (if the version changed)
[x] Re-rendered with the latest conda-smithy (Use the phrase @conda-forge-admin, please rerender in a comment in this PR for automated rerendering)
[ ] Ensured the license file is being packaged.

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.
I do have some suggestions for making it better though...
For recipe:

License is not an SPDX identifier (or a custom LicenseRef) nor an SPDX license expression.

Documentation on acceptable licenses can be found here.

Hi! This is the friendly automated conda-forge-linting service.
I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

This is ready for review @conda-forge/nano

A gentle ping for a review @conda-forge/nano @conda-forge/core

Looks like libiconv is not needed. See the warning.
WARNING (nano): run-exports library package conda-forge::libiconv-1.16-h516909a_0 in requirements/run but it is not used (i.e. it is overdepending or perhaps statically linked? If that is what you want then add it to `build/ignore_run_exports`)


Usage of Docker Tags for Runtime Versioning

This is a duplicate of the following issue I created on the lambci/docker-lambda repo. https://github.com/lambci/docker-lambda/issues/191
During the recent upgrade for the execution environments we noticed that would could not make a deterministic update because tags used in lambci/docker-lambda are for languages (https://hub.docker.com/r/lambci/lambda/tags) and not for versions of the execution environment. Not have version tags for major changes means it is hard for downstream users to migrate to the new runtime in a predictable way. It could also mean new containers could break build pipelines during the transition phase.
I wanted to file this duplicate issue to share my experiences and see if there is some additional thinking here since SAM uses these containers. Thanks y'all!

docker-lambda now does this for large refactors, see https://github.com/lambci/docker-lambda/issues/191#issuecomment-557824167

Cool, I'll close this issue now too.


There is no data in gdelt_chatgpt. 数据库gdelt_chatgpt中没有数据

I read an empty dictionary from the dictdatabase database named 'gdelt_chatgpt'. How can I resolve this issue?我从名为 'gdelt_chatgpt' 的 dictdatabase 数据库中读取到了一个空字典，我该如何解决这个问题？

Here is the translation:
Before running the second part of the code, I found that there was no database named "gdelt_chatgpt" in the project. After running the code, an empty database named "gdelt_chatgpt" was created. Then an error occurred: "argument of type 'NoneType' is not iterable." This is because init_db read the empty data from "gdelt_chatgpt" and attempted to iterate over it in the following code: if str(idx) in init_db and str(rel_or_obj) in init_db[str(idx)]. I'm wondering if this situation is normal, or how should I resolve it?

Before running the second part of the code, I found that there was no database named "gdelt_chatgpt" in the project. After running the code, an empty database named "gdelt_chatgpt" was created. Then an error occurred: "argument of type 'NoneType' is not iterable." This is because init_db read the empty data from "gdelt_chatgpt" and attempted to iterate over it in the following code: if str(idx) in init_db and str(rel_or_obj) in init_db[str(idx)]. I'm wondering if this situation is normal, or how should I resolve it?


lca: Limiting the client for pull and newbuilder for lca

This is based on assignment
https://github.com/openshift-kni/eco-goinfra/issues/299

cc @trewest @kononovn

successfully tested

It's interesting that the Client variable is actually an interface.

It's interesting that the Client variable is actually an interface.

@sebrandon1 I think this is the underlying struct that implements Client. It's set here


Relay C++ Build Module

Currently most schedules are written in Python. I tested on CPU environment this building module is able to pass a dense + relu test with Python schedules. To fully replace Python build module, port some AutoTVM feature to C++ is necessary.

ping reviewers...

Sorry about the slow review, been a busy week! Thanks for rewriting so much code into C++, my feedback is mostly stylistic.
Can you review @MarisaKirisame?

Sorry about the slow review, been a busy week! Thanks for rewriting so much code into C++, my feedback is mostly stylistic.
Can you review @MarisaKirisame?

General feedback: I would suggest a pass over the code to revise the \brief comments - try to include the purpose of the class/function.

@jroesch Updated.

@jroesch @MarisaKirisame @tqchen Could one of you review this PR again?

Updated.

@antinucleon Looks good to me, one last question when will we replace the Python code currently in build_module.py? having two code paths that do the same thing makes me nervous, it would be good to remove all that code if possible.

@jroesch We have to wait AutoTVM is ported to C++, then we are able to replace Python build_module.

Why can't we just expose the necessary Python functions and call them from C++?

@jroesch For fully migrating to C++, we have to do step by step, as the python module is not typed and fixing all these case need quite a lot of work.

Ok sounds good. We can do it incrementally.


fortune-mod: 2.10.0 -> 3.2.0

Motivation for this change
Update and add update script as well.
Things done

[X] Tested using sandboxing (nix.useSandbox on NixOS, or option sandbox in nix.conf on non-NixOS linux)
Built on platform(s)

[X] NixOS
[ ] macOS
[ ] other Linux distributions

[ ] Tested via one or more NixOS test(s) if existing and applicable for the change (look inside nixos/tests)
[x] Tested compilation of all pkgs that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review wip"
[x] Tested execution of all binary files (usually in ./result/bin/)
[x] Determined the impact on package closure size (by running nix path-info -S before and after)
[ ] Ensured that relevant documentation is up to date
[x] Fits CONTRIBUTING.md.

Result of nixpkgs-review pr 102027 run on x86_64-linux 1

2 packages failed to build:

gtypist
xcowsay

2 packages built:

ding
fortune

Result of nixpkgs-review pr 102027 run on x86_64-linux 1

4 packages built:

ding
fortune
gtypist
xcowsay

Result of nixpkgs-review pr 102027 run on x86_64-darwin 1

2 packages built:

fortune
gtypist

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-ready-for-review/3032/353

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:
https://discourse.nixos.org/t/prs-already-reviewed/2617/281