kubectl set image fails in minikube when image is present in its docker (hello minikube tutorial)

This is a...

[ ] Feature Request
[x] Bug Report

Problem:
Tutorial says to update deployment image with kubectl set image but it fails:
-> % kubectl set image deployment/hello-node hello-node=hello-node:v2
error: unable to resolve image "hello-node:v2" for container "hello-node": unable to resolve  "hello-node:v2"

Original deployment was created as tutorial said by kubectl run hello-node --image=hello-node:v1 --port=8080 and it has imagePullPolicy == IfNotPresent but still tries to pull locally available image.
Proposed Solution:
N/A yet, to be discussed.
Page to Update:
http://k8s.io/docs/tutorials/stateless-application/hello-minikube/
Component versions:
-> % kubectl version
Client Version: version.Info{Major:"1", Minor:"5", GitVersion:"v1.5.2+43a9be4", GitCommit:"43a9be4", GitTreeState:"clean", BuildDate:"2017-05-16T16:36:05Z", GoVersion:"go1.7.5", Compiler:"gc", Platform:"linux/amd64"}
Server Version: version.Info{Major:"1", Minor:"6", GitVersion:"v1.6.4", GitCommit:"d6f433224538d4f9ca2f7ae19b252e6fcb66a3ae", GitTreeState:"dirty", BuildDate:"2017-06-22T04:31:09Z", GoVersion:"go1.7.5", Compiler:"gc", Platform:"linux/amd64"}
-> % minikube version
minikube version: v0.20.0

Current minikube and environment state:
-> % env | rgi docker
DOCKER_TLS_VERIFY=1
DOCKER_HOST=tcp://<IP_ADDRESS>:2376
DOCKER_CERT_PATH=/home/gross/.minikube/certs
DOCKER_API_VERSION=1.23
> % docker images | rgi hello-node | column -t
hello-node  v2  f145275015ba  19  hours  ago  660MB
hello-node  v1  3745b7a1125f  19  hours  ago  660MB

-> % kubectl get deployment/hello-node -o yaml
apiVersion: extensions/v1beta1
kind: Deployment
metadata:
  annotations:
    deployment.kubernetes.io/revision: "1"
  creationTimestamp: 2017-07-19T18:19:28Z
  generation: 1
  labels:
    run: hello-node
  name: hello-node
  namespace: default
  resourceVersion: "105016"
  selfLink: /apis/extensions/v1beta1/namespaces/default/deployments/hello-node
  uid: cd87afbc-6cae-11e7-b1c5-5254001164ac
spec:
  replicas: 1
  selector:
    matchLabels:
      run: hello-node
  strategy:
    rollingUpdate:
      maxSurge: 1
      maxUnavailable: 1
    type: RollingUpdate
  template:
    metadata:
      creationTimestamp: null
      labels:
        run: hello-node
    spec:
      containers:
      - image: hello-node:v1
        imagePullPolicy: IfNotPresent
        name: hello-node
        ports:
        - containerPort: 8080
          protocol: TCP
        resources: {}
        terminationMessagePath: /dev/termination-log
        terminationMessagePolicy: File
      dnsPolicy: ClusterFirst
      restartPolicy: Always
      schedulerName: default-scheduler
      securityContext: {}
      terminationGracePeriodSeconds: 30
status:
  availableReplicas: 1
  conditions:
  - lastTransitionTime: 2017-07-19T18:19:28Z
    lastUpdateTime: 2017-07-19T18:19:28Z
    message: Deployment has minimum availability.
    reason: MinimumReplicasAvailable
    status: "True"
    type: Available
  observedGeneration: 1
  readyReplicas: 1
  replicas: 1
  updatedReplicas: 1

Also kubectl edit deployment/hello-node or deployment yaml edit via dashboard updates image flawlessly.

It doesn't reproduce in kubeadm-bootstrapped environment on centos7 (w/ calico network) and same commands as for minikube, so, I'll create an issue against kubernetes/minikube


Add parse_xml_html method to bloblang to escape HTML characters

parse_xml_html is essentially the parse_xml method that escapes HTML tags instead of truncating the content after them.
This PR is another way to provide a solution to issue #616 .
There is a default list of HTML tags that are escaped:
b, i, u, em, strike, sup, small, tt, pre, blockquote, strong, font.
But you can supply your own list too.
root.doc = this.doc.parse_xml_html()
{"doc":"<root><title>This is a title</title><content>This is some bold and italic content</content></root>"}
{"doc":{"root":{"content":"This is some bold and italic content","title":"This is a title"}}}

root.doc = this.doc.parse_xml_html(["b", "i"])
{"doc":"<root><title>This is a title</title><content>This is some bold and italic content</content></root>"}
{"doc":{"root":{"content":"This is some bold and italic content","title":"This is a title"}}}

Compare the above to the existing parse_xml
root.doc = this.doc.parse_xml()
{"doc":"<root><title>This is a title</title><content>This is some bold and italic content</content></root>"}
{"doc":{"root":{"content":"This is some","title":"This is a title"}}}

This is based on a modified version of the solution provided in the issue here
@Jeffail what do you think of this option?
Thanks

Hey @salimane, since this is doing standard replaces before the parse I would prefer to have a clean way of doing a map of replaces (https://www.benthos.dev/docs/guides/bloblang/methods#replace) rather than adding a new method. Maybe something like
let element_swaps = [
  "
", "<p>",
  "", "<strong>",
]
root = foo.replace_many($element_swaps).parse_xml()

Hey @salimane, since this is doing standard replaces before the parse I would prefer to have a clean way of doing a map of replaces (https://www.benthos.dev/docs/guides/bloblang/methods#replace) rather than adding a new method. Maybe something like
let element_swaps = [
  "
", "<p>",
  "", "<strong>",
]
root = foo.replace_many($element_swaps).parse_xml()

I have opened a new PR for replace_many

I have opened a new PR for replace_many

Closing in favour of https://github.com/Jeffail/benthos/pull/624

Closing in favour of https://github.com/Jeffail/benthos/pull/624


Devices found in TasUI but won't appear in homebridge

Awesome plugin and the auto-discovery feature is amazing. I can find and control my devices in TasUI and add them to saved devices but no matter what I try I can't seem to reveal them as accessories in homebridge. I feel like I'm missing some instruction but it isn't clear from the GitHub page. Maybe install and setup instructions could be a bit more specific.

Did you do this ?
https://github.com/NorthernMan54/homebridge-tasmota#tasmota-device-config


transmission: 3.00 → 4.0.2

Description of changes
Transmission 4.0.2 is a major change from 3.00. Several components, including the web interface, have been rewritten. The libtransmission API now requires C++, breaking compatibility with some old programs. The RPC clients now also use different APIs, but I believe they are backwards and forwards compatible.
This is a draft because some packages cannot use Transmission 4.0 due to the changes so I had to create new transmission_3 packages. I'm not sure about how to name those.
Things done

Built on platform(s)

[x] x86_64-linux
[ ] aarch64-linux
[ ] x86_64-darwin
[ ] aarch64-darwin

[ ] For non-Linux: Is sandbox = true set in nix.conf? (See Nix manual)
[x] Tested, as applicable:

NixOS test(s) (look inside nixos/tests)
and/or package tests
or, for functions and "core" functionality, tests in lib/tests or pkgs/test
made sure NixOS tests are linked to the relevant packages

[x] Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
[x] Tested basic functionality of all binary files (usually in ./result/bin/)
23.05 Release Notes (or backporting 22.11 Release notes)

[ ] (Package updates) Added a release notes entry if the change is major or breaking
[ ] (Module updates) Added a release notes entry if the change is significant
[ ] (Module addition) Added a release notes entry if adding a new NixOS module

[x] Fits CONTRIBUTING.md.

See https://github.com/NixOS/nixpkgs/pull/215316

Weird, I didn't see that when I searched.

This is a dupe of the other PR, except the 4.0.2 bump. Can I close this out?

Obviously this can be closed since https://github.com/NixOS/nixpkgs/pull/241146 has been merged.


OAuth2AuthorizationCodeAuthenticationProvider does not properly deserialize OAuth2Authorization object attributes

Describe the bug
When using the JDBC implementation for OAuth2AuthorizationService, the OAuth2AuthorizationCodeAuthenticationProvider is not able to properly deserialize the stored attributes within OAuth2Authorization object upon authentication. Specifically, the attributes within OAuth2Authorization object are stored as LinkedHashMaps, and when it comes time for OAuth2AuthorizationCodeAuthenticationProvider.authenticate method to use the attributes, a ClassCastException is thrown due to the fact that a LinkedHashMap is not castable to a specific object, such as an OAuth2AuthorizationRequest (one of the attributes). All attributes suffer from this casting issue.
To Reproduce

Enable JDBC implementation of at least OAuth2AuthorizationService. Ideally, all services should be JDBC-based.
Set up H2 In-memory database, and load schema as defined in src/main/resources.
Launch the authorization server, sample client, and sample resource server
Navigate to sample client (http://localhost:8080)
Get redirected to auth server, sign in with user1/password, you will be redirected back.
Observe error: too many redirects in browser. ClassCastException on server console.

Should be similar to the following:
java.lang.ClassCastException: java.util.LinkedHashMap incompatible with org.springframework.security.oauth2.core.endpoint.OAuth2AuthorizationRequest
	at org.springframework.security.oauth2.server.authorization.authentication.OAuth2AuthorizationCodeAuthenticationProvider.authenticate(OAuth2AuthorizationCodeAuthenticationProvider.java:121) ~[main/:na]

Expected behavior

Enable JDBC implementation of at least OAuth2AuthorizationService. Ideally, all services should be JDBC-based.
Launch the authorization server, sample client, and sample resource server
Navigate to sample client
Get redirected to auth server, sign in with user1/password, you will be redirected back.
Observe resources fetched from resource server (no errors)

Sample
Commit that replicates the bug

Thanks for the report @ddubson. We discovered the bug as well and are currently working on a fix.

im facing the same issue with custom implementation of OAuth2AuthorizationService with mongodb with 0.4.0 version is there any way to fix this??


Integrate Autoware FMS

Able to run FMS in humble_0.9.14
Also, we need to update the documentation.

Done with https://github.com/evshary/autoware_carla_launch/pull/80


[issue-553][issue-544]throw exception while complex datatype not at the end of dims

we need to check the user schema whether the complex datatype at the end of dimensions.
this pr will force user to make sure complex datatype at last.
and also fix one bug in complex data type order in schema different with csv header order.

@ravikiran23 @nareshpr please help to review.

add links of issue
issue-553 Dataload need to sort order:dimension+complex+measure
issue-544 Data load failure when statement contain complex datatype and dictionary_include contain double type

all comment handled.please review.
@nareshpr

after discuss with @kumarvishal09 ,suggestion is when complex datatype is on at the end of dimension,then throw MalformedCarbonCommandException.

better to find root cause and fix it.

retest this please

retest this please


the object does not get between the grippers.

Hi, Jennifer. I'm trying to get a 3 DOF voice-controlled robot to do the pick and place operation. The grippers can't fully grasp and lift the object. When I give the command to lift the arm, the arm lifts up, but the object does not rise. What can I do to get the body up along with the arm ?

Hi. I'm sorry for the late response. I didn't see this before now. I recommend you look at the wiki, the grasp plugin has to be set up for the robot.


Implemented CoinGecko api to get token prices

[ ] issue #86
[ ] follows contribution guide
[ ] code change includes tests
[ ] breaking change

resolved conflicts and merged locally


[Enhancement] Support array type for Trino parser on starrocks

What type of PR is this：

[ ] BugFix
[ ] Feature
[x] Enhancement
[ ] Refactor
[ ] UT
[ ] Doc
[ ] Tool

Which issues of this PR fixes ：

#14825
Problem Summary(Required) ：

Support query array type for Trino parser on starrocks
Support some array function transform
Support transform trino function with variable arguments, such like concat(array1,array2,....)

Checklist:

[ ] I have added test cases for my bug fix or my new feature
[ ] This pr will affect users' behaviors
[ ] This pr needs user documentation (for new or modified features or behaviors)

[ ] I have added documentation for my new feature or new function

Bugfix cherry-pick branch check:

[ ] I have checked the version labels which the pr will be auto backported to target branch

[ ] 2.5
[ ] 2.4
[ ] 2.3
[ ] 2.2

[FE PR Coverage Check]
:heart_eyes: pass : 61 / 63 (96.83%)
file detail

path
covered_line
new_line
coverage
not_covered_line_detail

:large_blue_circle:
com/starrocks/connector/parser/trino/AstBuilder.java
6
7
85.71%
[436]

:large_blue_circle:
com/starrocks/connector/parser/trino/FunctionCallTransformer.java
34
35
97.14%
[96]

:large_blue_circle:
com/starrocks/connector/parser/trino/Trino2SRFunctionCallTransformer.java
21
21
100.00%
[]

run starrocks_admit_test


Xcode build failed

When I tried to take iOS release build with flutter build ios command. I got this below stack trace.
Currently, I'm using fluttertoast: 4.0.1
Xcode's output: ↳     In file included from /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.m:26:     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:328:19: warning: empty     paragraph passed to '@param' command [-Wdocumentation]      @param sharedStyle      ~~~~~~~~~~~~~~~~~^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:343:25: warning: empty     paragraph passed to '@param' command [-Wdocumentation]      @param allowTapToDismiss      ~~~~~~~~~~~~~~~~~~~~~~~^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:343:9: warning: parameter     'allowTapToDismiss' not found in the function declaration [-Wdocumentation]      @param allowTapToDismiss             ^~~~~~~~~~~~~~~~~     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:343:9: note: did you mean     'tapToDismissEnabled'?      @param allowTapToDismiss             ^~~~~~~~~~~~~~~~~             tapToDismissEnabled     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:362:20: warning: empty     paragraph passed to '@param' command [-Wdocumentation]      @param queueEnabled      ~~~~~~~~~~~~~~~~~~^     4 warnings generated.     In file included from     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/FluttertoastPlugin.m:2:     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:328:19: warning: empty     paragraph passed to '@param' command [-Wdocumentation]      @param sharedStyle      ~~~~~~~~~~~~~~~~~^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:343:25: warning: empty     paragraph passed to '@param' command [-Wdocumentation]      @param allowTapToDismiss      ~~~~~~~~~~~~~~~~~~~~~~~^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:343:9: warning: parameter     'allowTapToDismiss' not found in the function declaration [-Wdocumentation]      @param allowTapToDismiss             ^~~~~~~~~~~~~~~~~     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:343:9: note: did you mean     'tapToDismissEnabled'?      @param allowTapToDismiss             ^~~~~~~~~~~~~~~~~             tapToDismissEnabled     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:362:20: warning: empty     paragraph passed to '@param' command [-Wdocumentation]      @param queueEnabled      ~~~~~~~~~~~~~~~~~~^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/FluttertoastPlugin.m:19:23: warning: unused     variable 'viewController' [-Wunused-variable]         UIViewController *viewController =                           ^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/FluttertoastPlugin.m:70:21: warning: unused     variable 'topPadding' [-Wunused-variable]                 CGFloat topPadding = window.safeAreaInsets.top;                         ^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/FluttertoastPlugin.m:71:21: warning: unused     variable 'bottomPadding' [-Wunused-variable]                 CGFloat bottomPadding = window.safeAreaInsets.bottom;                         ^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/FluttertoastPlugin.m:48:19: warning: unused     variable 'size' [-Wunused-variable]             NSNumber *size = call.arguments[@"size"];                       ^     8 warnings generated.     In file included from /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.m:26:     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:328:19: warning: empty     paragraph passed to '@param' command [-Wdocumentation]      @param sharedStyle      ~~~~~~~~~~~~~~~~~^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:343:25: warning: empty     paragraph passed to '@param' command [-Wdocumentation]      @param allowTapToDismiss      ~~~~~~~~~~~~~~~~~~~~~~~^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:343:9: warning: parameter     'allowTapToDismiss' not found in the function declaration [-Wdocumentation]      @param allowTapToDismiss             ^~~~~~~~~~~~~~~~~     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:343:9: note: did you mean     'tapToDismissEnabled'?      @param allowTapToDismiss             ^~~~~~~~~~~~~~~~~             tapToDismissEnabled     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:362:20: warning: empty     paragraph passed to '@param' command [-Wdocumentation]      @param queueEnabled      ~~~~~~~~~~~~~~~~~~^     4 warnings generated.     In file included from     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/FluttertoastPlugin.m:2:     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:328:19: warning: empty     paragraph passed to '@param' command [-Wdocumentation]      @param sharedStyle      ~~~~~~~~~~~~~~~~~^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:343:25: warning: empty     paragraph passed to '@param' command [-Wdocumentation]      @param allowTapToDismiss      ~~~~~~~~~~~~~~~~~~~~~~~^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:343:9: warning: parameter     'allowTapToDismiss' not found in the function declaration [-Wdocumentation]      @param allowTapToDismiss             ^~~~~~~~~~~~~~~~~     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:343:9: note: did you mean     'tapToDismissEnabled'?      @param allowTapToDismiss             ^~~~~~~~~~~~~~~~~             tapToDismissEnabled     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/UIView+Toast.h:362:20: warning: empty     paragraph passed to '@param' command [-Wdocumentation]      @param queueEnabled      ~~~~~~~~~~~~~~~~~~^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/FluttertoastPlugin.m:19:23: warning: unused     variable 'viewController' [-Wunused-variable]         UIViewController *viewController =                           ^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/FluttertoastPlugin.m:70:21: warning: unused     variable 'topPadding' [-Wunused-variable]                 CGFloat topPadding = window.safeAreaInsets.top;                         ^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/FluttertoastPlugin.m:71:21: warning: unused     variable 'bottomPadding' [-Wunused-variable]                 CGFloat bottomPadding = window.safeAreaInsets.bottom;                         ^     /Users/vinothvino/Developer/flutter/.pub-cache/hosted/pub.dartlang.org/fluttertoast-4.0.1/ios/Classes/FluttertoastPlugin.m:48:19: warning: unused     variable 'size' [-Wunused-variable]             NSNumber *size = call.arguments[@"size"];                       ^     8 warnings generated.     fatal error: error in backend: IO failure on output stream: No space left on device     warning: Could not read serialized diagnostics file: Invalid File: Invalid diagnostics signature (in target 'FirebaseFirestore' from project     'Pods')     Command CompileC failed with a nonzero exit code     note: Using new build system     note: Building targets in parallel     note: Planning build     note: Constructing build description

same here

me too

me too

Need contributor who can work on iOS because i dont have a macbook

Yes i am ready for iOS


Fix Monge-Elkan example

The Monge-Elkan similarity of "Comput. Sci. and Eng. Dept., University of California, San Diego" and "Department of Computer Science, Univ. Calif., San Diego" is wrong in the example. The correct value is 0.8364448130130768.
Python 3.7.7 (default, Mar 10 2020, 15:43:33)
[Clang 11.0.0 (clang-1<IP_ADDRESS>)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import py_stringmatching as sm
>>> me = sm.MongeElkan()
>>> me.get_raw_score(['Comput.', 'Sci.', 'and', 'Eng.', 'Dept.,', 'University', 'of', 'California,', 'San', 'Diego'], ['Department', 'of', 'Computer', 'Science,', 'Univ.', 'Calif.,', 'San', 'Diego'])
0.8364448130130768

Coverage remained the same at 99.903% when pulling 23e1cd0495dbeacd71e759978b2e6f08f5c01b16 on wynksaiddestroy:fix-monge-elkan-example into 45c3a09c27e44691f0e850fe060640fa2adc3ce7 on anhaidgroup:master.

Any chance on getting this PR merged?


Cleanup ml extraction Makefile

This PR is purely cosmetic, it avoids printing the full output when extracting ulib/ to ml, but instead prints [EXTRACT  Module] and [LAXCHECK Module] similarly to what is done in other Makefiles.
Note, similarly to other Makefiles, this behaviour is overriden if make is run in verbose mode.

Thanks @R1kM!


How to use it?

Hi, I'm trying to figure out the DataTables for my project on Yii2. I have your widget, but I do not understand how to use it. Very few examples in README. For example, the following code is shown there:
$searchModel = new ModelSearch();
$dataProvider = $searchModel->search(Yii::$app->request->queryParams);

But what is this $searchModel? Or is it an ordinary ActiveRecord, and I'm asked to search for myself? It would be nice if-then there was a search (for all the parameters required for this are passed in the request as far as I understand). And what for $dataProvider again you use in the example? Do you need to implement it yourself?

It is an ordinary ActiveRecord. You can use it like a standard widget. See there are some examples:
http://www.yiiframework.com/doc-2.0/guide-output-data-widgets.html


[Feature Request]: Option to select which building blocks of a template to add

Contact Details
No response
Is your feature request related to a problem?
If you only want to add a couple of building blocks from a template, adding all building blocks from the template first and then deleting the ones you don't want can be a bit annoying.
Describe the solution you would like!
An option to select which building blocks of a template to add to your annotation table, instead of first adding all and then having to delete building blocks.
Additional context!
No response
Host
Applies to All
Host Details
all

Tracked in https://github.com/nfdi4plants/Swate/issues/499 will close here


Workspaces are not properly deleted

Create a workspace
Configure a cluster
Test & Connect
Exit and delete the cluster & workspace
Create another workspace using the same name as before
When you try to create a cluster, the details are already filled from the previous instance

This is not an issue but how the app behaving by default, even if the user has deleted a workspace and created another with different name he'll find the previous data he has filled to create a cluster, however, this will be changed; the fields will be cleared after a successful cluster adding/updating process.

Working on that. After a successful add/update process for both; workspace and cluster, fields in the each related dialogs will be cleared


ValueError: Sample larger than population or is negative?

The owner can help me solve this problem, which has been bothering me, thank you very much. The format of the dataset is exactly according to the format of readme, just prepare the base training and chmod the basetrain.sh.

Thank you for your interest in our work.
However, I am not able to reproduce your errors. Would you please let me know your full environments, full error logs, and etc.?
Thank you!

Since I switched to a new 4 class dataset with a base class of 3 and a new class of 1, there are errors reported for basic training. The error reporting is due to a sampling problem.

Thank you for your interest in our work. However, I am not able to reproduce your errors. Would you please let me know your full environments, full error logs, and etc.?
Thank you!

Since I switched to a new 4 class dataset with a base class of 3 and a new class of 1, there are errors reported for basic training. The error reporting is due to a sampling problem.


removed configurable request logger in server package. #255

I would like to revisit the logger at a later date and have it leverage the new logger implementation. For now this is a cleaning out something I would prefer to not support into the future.

Coverage increased (+0.2%) to 45.532% when pulling 9ef60314ebda27b535b62884c446625e190cc824 on issue-255 into b2f6f23ab6bec5cda6b1ea6484099f2ce1701958 on v0.6.0.


Asking about data

Hello, JP. Sorry to disturb you. I am Fiona, a student who is struggling for learning data assimilation methods related to covid19. I see your project which is very helpful to me. However I noticed you didn't upload “data.xlsx”. So would you mind uploading raw data file? Thank you very very much.

Hello, I will look into my local repo to upload them soon. Thank you for your interest !

It is now available

Thank you very much! Thanks for your reply!


default config: use 'enter' to 'confirm'

Otherwise, there is no way to positively close popups with the default
key bindings.

To test, remove your rsmixer config, press Enter and try to suspend the card. Unlike before (ie. after removing the rsmixer config and then running rsmixer), a second press of Enter actually suspends the card. Previously, it did nothing, and only q got you back out.

thank you very much, I forgot to add it when seperating open_context_menu from confirm

thank you very much, I forgot to add it when seperating open_context_menu from confirm


Critical dependency: the request of a dependency is an expression

When used in Next.js

Just found the same issue when trying to add trpcTracingMiddleware to the procedures as suggested in the docs.

Hey, this is a known issue.
https://github.com/open-telemetry/opentelemetry-js/issues/4173
If you add this to your next.config.js it will suppress the webpack warning
    webpack: (
        config,
        { buildId, dev, isServer, defaultLoaders, nextRuntime, webpack }
    ) => {
        if (isServer) {
            config.ignoreWarnings = [
                { module: /opentelemetry/, },
            ]
        }
        return config
    },

@Ankcorn That solved it for me, thanks for the hint!

@Ankcorn Thanks for the hint, however it doesn't work for me. What I found and help me out is to change the type in NextJs.
In the .next/package.json I changed the type from "CommonJs" to "module" and it solves all the error.


UnicodeDecodeError at ProcessCollector.collect()

Hi, i get the following error when i try to run my app with Gunicorn:
Failed to read config file: gunicornconfig.py
Traceback (most recent call last):
  File "/home/vasilek/coller_app/env/lib/python3.6/site-packages/gunicorn/app/base.py", line 93, in get_config_from_filename
    execfile_(filename, cfg, cfg)
  File "/home/vasilek/coller_app/env/lib/python3.6/site-packages/gunicorn/_compat.py", line 72, in execfile_
    return six.exec_(code, *args)
  File "gunicornconfig.py", line 1, in <module>
    from prometheus_client import multiprocess
  File "/home/vasilek/coller_app/env/lib/python3.6/site-packages/prometheus_client/__init__.py", line 5, in <module>
    from . import process_collector
  File "/home/vasilek/coller_app/env/lib/python3.6/site-packages/prometheus_client/process_collector.py", line 93, in <module>
    PROCESS_COLLECTOR = ProcessCollector()
  File "/home/vasilek/coller_app/env/lib/python3.6/site-packages/prometheus_client/process_collector.py", line 39, in __init__
    registry.register(self)
  File "/home/vasilek/coller_app/env/lib/python3.6/site-packages/prometheus_client/core.py", line 50, in register
    names = self._get_names(collector)
  File "/home/vasilek/coller_app/env/lib/python3.6/site-packages/prometheus_client/core.py", line 86, in _get_names
    for metric in desc_func():
  File "/home/vasilek/coller_app/env/lib/python3.6/site-packages/prometheus_client/process_collector.py", line 56, in collect
    parts = (stat.read().split(')')[-1].split())
  File "/home/vasilek/.pyenv/versions/3.6.4/lib/python3.6/codecs.py", line 321, in decode
    (result, consumed) = self._buffer_decode(data, self.errors, final)
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xd0 in position 21: invalid continuation byte

App is started with command: gunicorn -b <IP_ADDRESS> app:api --config gunicornconfig.py --workers=4 --log-level=DEBUG --worker-class=aiohttp.worker.GunicornWebWorker --reload
Contents of gunicornconfig.py are taken straight from multiprocessing tutorial for this module:
from prometheus_client import multiprocess

def child_exit(server, worker):
    multiprocess.mark_process_dead(worker.pid)

Other packages:
python 3.6.4
gunicorn 19.7.1
prometheus-client 0.1.0

I'm guessing you have some non-ASCII process names, and we should be opening the stat file in binary mode.

@brian-brazil
I changed the following lines in process_collector.py (lines 56-57):
with open(os.path.join(pid, 'stat')) as stat:
    parts = (stat.read().split(')')[-1].split())

to:
with open(os.path.join(pid, 'stat'), 'rb') as stat:
    print(stat.read())

Got this output:
b'9832 (/home/vasilek/\xd0) R 9828 9828 5755 34818 9828 4194304 4342 0 0 0 36 2 0 0 20 0 1 0<PHONE_NUMBER>95616 5768<PHONE_NUMBER>3709551615 4194304 6707556<PHONE_NUMBER>21072 0 0 0 0 16781312 2 0 0 0 17 1 0 0 0 0 0 8805840 9211976 20926464<PHONE_NUMBER>29641<PHONE_NUMBER>29956<PHONE_NUMBER>29956<PHONE_NUMBER>33948 0\n'

Yip, that's not ASCII. Could you send a pull request?

Sure, will do in a couple of days.


Add wildcards to textual search unless there are operators

@robvandenbogaard added option to disable the auto-wildcard behavior in case it gives problems.


Revert tagging attempt

This does not work.
https://docs.microsoft.com/en-gb/azure/azure-resource-manager/management/tag-resources in the only way which we cant support at this point :/

Merging.  Opened https://msazure.visualstudio.com/AzureRedHatOpenShift/_workitems/edit/8837324 to have another go at this.


bug in Nuxt Build

when i run "Nuxt build"  in my project i got this error
ERROR   /                                                                                18:37:36
TypeError: Cannot read property 'renderRoute' of undefined
at Generator.generateRoute (/home/yalladealz/Frontend/node_modules/@nuxt/generator/dist/generator.js:400:42)
at async /home/yalladealz/Frontend/node_modules/@nuxt/generator/dist/generator.js:266:13
at async Promise.all (index 0)
at async Generator.generateRoutes (/home/yalladealz/Frontend/node_modules/@nuxt/generator/dist/generator.js:261:7)
at async Generator.generate (/home/yalladealz/Frontend/node_modules/@nuxt/generator/dist/generator.js:139:20)
at async Object.run (/usr/local/share/.config/yarn/global/node_modules/@nuxt/cli/dist/cli-build.js:100:7)
at async NuxtCommand.run (/usr/local/share/.config/yarn/global/node_modules/@nuxt/cli/dist/cli-index.js:2759:7)
FATAL  Cannot read property 'renderRoute' of undefined                                                                                18:37:36
at Generator.afterGenerate (node_modules/@nuxt/generator/dist/generator.js:314:43)
at async Generator.generate (node_modules/@nuxt/generator/dist/generator.js:141:5)
at async Object.run (/usr/local/share/.config/yarn/global/node_modules/@nuxt/cli/dist/cli-build.js:100:7)
at async NuxtCommand.run (/usr/local/share/.config/yarn/global/node_modules/@nuxt/cli/dist/cli-index.js:2759:7)

but project run normally if i use " Npm run build"

but project run normally if i use " Npm run build"

This was resolved via Discord - issue was mistakenly running nuxt build instead of nuxt-ts build (as specified in package.json build script).

This was resolved via Discord - issue was mistakenly running nuxt build instead of nuxt-ts build (as specified in package.json build script).


How to evaluate APIbank with local model

Is there a way  to evaluate the benchmark with local model like LLama or Vicuna using FastChat ?

Refer to evaluator.py and utils.py to implement a Wrapper, and modify the content of evaluator.py for testing.


Add support for autocast custom ops in GaudiTrainer

What does this PR do?

For some models, specifying custom bf16 and fp32 ops for Torch Autocast can lead to significant speedups. This PR enables users to specify such custom ops the same way as with HMP and they will be recognized by the trainer.
Before submitting

[ ] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
[ ] Did you make sure to update the documentation with your changes?
[ ] Did you write any new necessary tests?

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

@regisss  LGTM! 👍
one question, when will you decided to remove HMP totally, or just leave it there?

@ZhaiFeiyue The only remaining obstacle is to make Wav2Vec2 training work. @libinta is taking a look at it in HS-1107.
Once this is cleared, I'll publish new Gaudi configs for GPT2 and Wav2Vec2 and release a patch to make sure everything works fine with autocast.
Finally, when SynapseAI 1.12 is released, I'll merge #349 to completely remove HMP.

that's great!


Expose MesssageConsumer callback mechanism in the C interface

Will give us the ability to communicate multiple messages during a single invocation of an API function. (Right now the diagnostic object can only return a single issue.)

If we got by without it this long, we might be fine. If someone wants it they can open a new issue.


Python 3 support

This tool should likely support python3. Hopefully only a few changes necessary to get this working, but this change should probably wait for https://github.com/lcary/nbd/issues/2.

Done. See: #12


build: update build environment (PROOF-899)

Updates nix flakes to latest versions
Updates clang to latest main commit
Updates bazel to version 7
Updates cuda toolkit to 12.6
Some minor formatting and other tweaks to fix errors and warnings.

:tada: This PR is included in version 1.78.4 :tada:
The release is available on GitHub release
Your semantic-release bot :package::rocket:


Typo in README.md: it said C# instead of C++

Hello, StarUML.
I found there was a mistaken word in README.md file. The mistaken word is C# in line 97. It says:

Select a folder containing C# source files to be converted to UML model elements.`

instead of

Select a folder containing C++ source files to be converted to UML model elements.`

Sorry if I don't make a pull request because it's just a typo.

Thank you for reporting an issue. It has fixed.

Thank you for reporting an issue. It has fixed.


Deletes threads from the thread_to_held_mutexes BPF map.
Adds --pid flag for targeted tracing based on process ID (tgid).

How to use
Just run the gadget with the --pid flag set:
sudo ig run deadlock:latest --pid=53240

Testing done

Ran my test container that has a binary that emits deadlock events.
Ran the binary inside the test container and found it's pid using trace_exec.
Ran the deadlock gadget with --pid flag set.
Confirmed that the events were showing up. Ran the binary again (this time a diff pid), and the events don't show up as expected.
For clean-up, just verified if I am able to successfully receive the dead PID in wasm code.

Some questions:

Currently, we are sending PID after every process ends, to userspace. Can this clog things up? Should we maintain another map to track only the PIDs of interest?
We could optimize memory further by also cleaning up the edges bpf map. This will also allow the gadget to handle cases when PID is reused by a new process. But currently, the key of the map has pid, mutex1, and mutex2. To clean all entries of a PID, we might have to traverse every entry to find what to clean up. Is there a better solution?


Center of mass visual

🎉 New feature
Summary
Adds center of mass visual consisting of a solid sphere with axis lines.

Test it
I have added an example in the visualization_demo.
Checklist

[x] Signed all commits for DCO
[x] Added tests
[x] Added example and/or tutorial
[ ] Updated documentation (as needed)
[ ] Updated migration guide (as needed)
[x] codecheck passed (See contributing)
[ ] All tests passed (See test coverage)
[ ] While waiting for a review on your PR, please help review another open pull request to support the maintainers

Note to maintainers: Remember to use Squash-Merge

Ogre1 doesn't seem to have a proper scaling for the cross-lines -

This pull request has been mentioned on Gazebo Community. There might be relevant details there:
https://community.gazebosim.org/t/google-summer-of-code-2021-new-gui-widgets-in-ignition-gazebo/1081/1


CreatePersonResult not available in PersonGroup

I'm trying to use CreatePersonResult to create a PersonGroup as described in the Face API documentation.
I've downloaded the nuget : Microsoft.Azure.CognitiveServices.Face to my solution.
I'm getting a missing reference to the CreatePersonResult.
I think the reference is from the old plugin Project.Oxford.Face
Please let me know what am I missing.
Link - https://docs.microsoft.com/en-us/azure/cognitive-services/face/face-api-how-to-topics/howtoidentifyfacesinimage

Document Details
⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

ID: f5f087f4-64bd-ebda-e5b9-540bf9cd041e
Version Independent ID: 9885cd90-3d7c-1ede-4992-e8408f048d9a
Content: Example: Identify faces in images - Face API - Azure Cognitive Services
Content Source: articles/cognitive-services/Face/Face-API-How-to-Topics/HowtoIdentifyFacesinImage.md
Service: cognitive-services
GitHub Login: @SteveMSFT
Microsoft Alias: sbowles

@VisakhRaman Thanks for the feedback! We are currently investigating and will update you shortly.

@VisakhRaman Can you provide the URL of the Nuget package?
I found one link on the doc which took me to this specific Nuget package which I believe isn't the one you are using, right? https://www.nuget.org/packages/Microsoft.ProjectOxford.Face/

According to the documentation, the nuget package recommended is Microsoft.Azure.CognitiveServices.Vision.Face
URL - https://www.nuget.org/packages/Microsoft.Azure.CognitiveServices.Vision.Face/1.0.2-preview
ProjectOxford.Face has been deprecated ,right?

@VisakhRaman Thanks for your valuable feedback! That is also my understanding that now is the Face API also I did reproduce the issue. I have assigned the issue to the content author though so he can evaluate and update as appropriate.

Any update on this?
I have some doubts that I'd like to refer to once the documentation is updated.

@SteveMSFT Hi Steve, can you please have a look at this issue? Thanks a lot!

@PatrickFarley Hi Patrick, would you please take a look at this issue? Thank you!

I've asked the PM owner which NuGet version is to be officially recommended.

Getting an error message: Microsoft.ProjectOxford.Face.FaceAPIException: 'Access denied due to invalid subscription key. Make sure you are subscribed to an API you are trying to call and provide the right key.(Unspecified)'. I created a new FaceAPI service on my azure account, and was able to use the keys to run this tutorial successfully: https://docs.microsoft.com/en-us/azure/cognitive-services/Face/tutorials/faceapiincsharptutorial
Does the code here, "Example: How to identify faces in images" require a different subscription and keys?

Got it, FaceServiceClient needed the key AND URL:     private readonly FaceServiceClient faceServiceClient = new FaceServiceClient(subscriptionKey2, "https://eastus.api.cognitive.microsoft.com/face/v1.0");

No that's not it. The latest nuget package is Microsoft. Azure.cognitiveservices.face.
Why does the document still use project Oxford?

Correct nuget pkg: https://www.nuget.org/packages/Microsoft.Azure.CognitiveServices.Vision.Face/2.2.0-preview
We are in the process of onboarding this to the main docs.microsoft.com repo. Changes will be made in the doc to reflect the appropriate package.

Use "Person" type.
Person friend1 = await _faceClient.PersonGroupPerson.CreateAsync


Sensors "Vehicle Info" and "Tyres" unavailable in 3.0.0 Beta 2

After upgrading to 3.0.0 Beta 2, Im missing Vehicle Info and Tyres sensors. I see following 2 errors in logs:

Error adding entities for domain sensor with platform jlrincontrol
Error while setting up jlrincontrol platform for sensor

Stack trace below is identical for both errors.
Diagnostics: config_entry-jlrincontrol-84eb59d8570d73fb8a3c684b79454890.json.txt
Logger: homeassistant.components.sensor
Source: helpers/entity_platform.py:507
Integration: Sensor (documentation, issues)
First occurred: 20:12:11 (1 occurrences)
Last logged: 20:12:11

Error adding entities for domain sensor with platform jlrincontrol
Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/util/unit_conversion.py", line 93, in _get_from_to_ratio
    return unit_conversion[from_unit], unit_conversion[to_unit]
                                       ~~~~~~~~~~~~~~~^^^^^^^^^
KeyError: None

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 507, in async_add_entities
    await asyncio.gather(*tasks)
  File "/usr/src/homeassistant/homeassistant/helpers/entity_platform.py", line 752, in _async_add_entity
    await entity.add_to_platform_finish()
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1282, in add_to_platform_finish
    self.async_write_ha_state()
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 945, in async_write_ha_state
    self._async_write_ha_state()
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1066, in _async_write_ha_state
    state, attr, capabilities, shadowed_attr = self.__async_calculate_state()
                                               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/helpers/entity.py", line 1006, in __async_calculate_state
    attr.update(self.extra_state_attributes or {})
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/config/custom_components/jlrincontrol/sensor.py", line 219, in extra_state_attributes
    unit_conversion.PressureConverter.convert(
  File "/usr/src/homeassistant/homeassistant/util/unit_conversion.py", line 73, in convert
    return cls.converter_factory(from_unit, to_unit)(value)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/util/unit_conversion.py", line 83, in converter_factory
    from_ratio, to_ratio = cls._get_from_to_ratio(from_unit, to_unit)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/src/homeassistant/homeassistant/util/unit_conversion.py", line 95, in _get_from_to_ratio
    raise HomeAssistantError(
homeassistant.exceptions.HomeAssistantError: None is not a recognized pressure unit.

To be more specific:

The Tyres sensor is created, but has state Unavailable
The Vehicle Info sensor is not created at all

In the config options, can you set a pressure unit option and see if this resolves it.  Need to look at why it is None and not defaulted.

Changing the Pressure unit override from bar to Default indeed resolved creation of the "Tyres" and "Vehicle Info" sensors.

Interesting note: in HA UI the pressure unit radio button bar where selected, but in diagnostic file value where None. When I selected Default in UI

Setting default value will be in beta3

I tried to verify the fix for default pressure from dev branch, by deleting the integration and reinstalling it. No error is displayed anymore and both sensors (Vehicle Info and Tyres) are created. But the Configuration UI has wrong radio button selected. bar is selected in UI, while diagnostic file says Pa (which is default value).
      "user_preferences": {
        "__type": "<class 'custom_components.jlrincontrol.coordinator.UserPreferenceUnits'>",
        "repr": "UserPreferenceUnits(distance=<UnitOfLength.KILOMETERS: 'km'>, fuel=<UnitOfVolume.LITERS: 'L'>, temp=<UnitOfTemperature.CELSIUS: '\u00b0C'>, pressure=<UnitOfPressure.PA: 'Pa'>, energy_regenerated=<UnitOfEnergy.KILO_WATT_HOUR: 'kWh'>, energy_consumed=<UnitOfEnergy.KILO_WATT_HOUR: 'kWh'>)"
      }

This line in config_flow.py needs to be updated as well: https://github.com/msp1974/homeassistant-jlrincontrol/blob/dev/custom_components/jlrincontrol/config_flow.py#L189

Verified that the Default radio button is correctly selected in Pressure Unit Override configuration. Closing the issue


Guardrail: Exception based handling if no context results are above Threshold for Similarity

Changes:

Introduces guardrail.GuardRailException for specific validation and GuardRail exceptions from DEH
Provides API handling of GuardRailExceptions as JSON output
Implements a chain compatible GuardRail for similarity exception

Merges changes from other PRs:

v0_measure
gpu4embedding

Just FYI - rebased to current main so file changes are just for this specific branch now.

I make changes to distance calculation and approach in next PR.  So would go ahead and merge this one and resolve any additional changes in future PRs.


False message "ValueError: opa command is required to evaluate OPA policies

To evalute if  opa is installed on the O.S. the function validate_opa_installation  in  utils.py use  which command to determinate the absolute path of 0opa binary, the issue is that some linux flavors which command is not installed by default (i.e archlinux, fedora, centos..), but this requirement in not documented,  install which command solve the issue, or deleting "which" in the line of code solved  to.
$ cat  ansible_policy/utils.py'
..
def validate_opa_installation(executable_name: str = "opa"):
    proc = subprocess.run(
        f"which {executable_name}",     <-----  # Line 36
        shell=True,
...

@yoal-carlangas Thank you very much for letting us know this!
I have updated the part to use command -v with this PR.
It would be merged soon.


Only create DRUIDs for DRO and Collections

@aaron-collier I don't think any such dependency exists, or if it does, was not introduced in this pull request.

@cmh2166 rebased.


Unix timestamps on axis type "time" do not render

Version
5.0.2
Reproduction link
https://codepen.io/azekthi/pen/dyOjdRm
Steps to reproduce
See reproduction link.
What is expected?
The timestamps should automatically convert to a date or time render in UTC, per https://echarts.apache.org/en/option.html#series-line.data
What is actually happening?
The line and the X-axis are not rendering.

The chart renders if the X axis is set to category instead of time.

It's better to convert the timestamp string to number. Or use the Date array / date string array.


UI support for cpu/mem/storage reservation parameters relating to resource based scheduler.

Rancher Version: Build from master
Expose following host parameters in host detail view and provide ability to edit them:
"localStorageMb"
"memory"
"milliCpu"
Expose following  launch config parameters when creating service/containers:
memoryReservation
milliCpuReservation

Tested with build from master:
Following host parameters in now available in host detail and edit view
"localStorageMb"
"memory"
"milliCpu"
Following parameters are available under "Security/Host" tab when creating service/containers:
memoryReservation
milliCpuReservation

hi @sangeethah: I'm trying to set the above constraints for a sample service, but it looks like that they're not being taken into effect. Where the memory and milliCpu constraints must be specified? Thanks.


Search unicode doesn't render on windows

Search button unicode symbol on main page isn't rendered correctly on Windows 7, chrome 54 (not on default Western (Windows1252), nor Unicode (UTF-8) encoding).

@dwelle thanks for pointing this out!
Any one have an idea of what we can do to fix this? I chose to use the unicode glyph over an icon from our icon-font (which I'm about to update) because @bebraw and I had discussed decoupling some of these components into their own repos. However we could always use the icon font for the time being and just extract the necessary svg if we ever make that move.

@skipjack agree with you, probably best to extract when we make that move.

Ok I'm about to try to introduce the fontgen-loader so I'll address this there as well.


Make it Clear Broken ChatGPT Code is Opportunity to Troubleshoot

Besides just looking at what ChatGPT is capable of, the broken code is left in there also so that people can take that code and try to fix it.
I think debugging other's code is a valuable skill and that should be made clear in README's and YT videos etc.

https://github.com/Kinvert/CUDA-Stuff/commit/de3161d4ed184ce99fa45dcbedec1cfd23ff856c


Isolate expensive expression evaluations in ChangeData

In the new architecture, by default, expressions are evaluated lazily. For instance, when using the "Add column based on this column" operation with some expression, the expression will only be evaluated for the rows that are actually shown on the screen, or are scanned by facets.
For operations which fetch data from external sources or have side-effects, there is another mechanism (ChangeData) to ensure that the corresponding data is fetched only once and stored in the project directory. This is used for instance by the URL fetching operation.
When an expression relies on external data (for instance using the cross function, or by calling HTTP services in Jython), we want to make sure it is evaluated exactly once per row and not more (so, using the ChangeData mechanism). Currently, all expressions are evaluated lazily, regardless of whether they are "local" or not (an expression is "local" if it does not perform any side effects and only reads data from the current row/record).
There is already a method in Evaluable to determine if an expression is local or not. We just need to add the downstream logic to switch between lazy / eager evaluation depending on that.

Done for the 'Add column based on this column' operation. Remaining: 'Transform' operation.

Done for the Transform operation too.


Ability to specify target filename

Description
Feature: Ability to specify target filename for the jar command to execute.
Right now it is only possible copy the project's filename into a folder. This means downstream docker-compose files can run the containers but cannot override the entryPoint without knowing the names of the artefacts involved.
Example: entryPoint ends up as java -jar /my-final-name-version-SNAPSHOT.jar
Right now I have about a dozen containers in a compose file. And I want to override the -Jmx settings. AFAICT I need to supply the full entrypoint for each container and that means not only knowing the Maven level project file name but also the Maven project version. That's a lot of knowledge spreading downstream that could change.
I tried specifying a targetPath that was in fact a filename but it still gets treated as a folder within the container.

I might be misunderstanding, but are you trying to control the name of the jar file produced by maven-jar-plugin? You can use build.finalName.

No, I'd like to control the name of the COPY target. So if build.finalName is my-project-1.7.5-SNAPSHOT I would like instead to copy this JAR into /runtime.jar that that the entrypoint becomes java -jar /runtime.jar instead of java -jar /my-project-1.7.5-SNAPSHOT.jar.
Thus across versions the entrypoint can remain unchanged.

Sorry for the delay in responding, but I think the best bet in this situation is to supply your own Dockerfile to the plugin. I think there is a limit to how customizable it makes sense to allow the auto-generated Dockerfile to be.

I was able to accomplish this. The idea is to have a  ${basedir}/Dockerfile that maven uses as resource filtering and includes it within ${basedir}/src/main/docker/.
Resource Filtering
Copying Resource
Please make sure that ${basedir}/src/main/docker/ exists
on your pom.xml
<plugin>
	<artifactId>maven-resources-plugin</artifactId>
	<version>3.0.2</version>
	<executions>
		<execution>
			<id>copy-resources</id>
			<phase>validate</phase>
			<goals>
				<goal>copy-resources</goal>
			</goals>
			<configuration>
				<outputDirectory>${basedir}/src/main/docker/</outputDirectory>
				<resources>
					<resource>
						<directory>${basedir}</directory>
						<includes>
							<include>Dockerfile</include>
						</includes>
						<filtering>true</filtering>
					</resource>
				</resources>
			</configuration>
		</execution>
	</executions>
</plugin>

In ${basedir}/Dockerfile, Please note we are using @VAR-NAME@ instead of ${VAR-NAME}
FROM java:8
VOLUME /tmp
ADD<EMAIL_ADDRESS>app.jar
RUN bash -c 'touch /app.jar'
EXPOSE 8888
ENTRYPOINT ["java","-Djava.security.egd=file:/dev/./urandom","-jar","/app.jar"]


Simplify bin's naming in Cargo.toml

Currently it is required to have such in Cargo.toml
[[bin]]
name = "my_project_build_contract"
path = "bin/build_contract.rs"
test = false

[[bin]]
name = "my_project_build_schema"
path = "bin/build_schema.rs"
test = false

It gets in the way when using workspace or even renaming the crate. The better way would be just name it name = "build_contract" and name = "build_schema".

It's actually needed to be this way, for the purpose of running it in workspace context.


Merge prTesting_201905121024 branch to master branch

Docs Build status updates of commit 5449364:
:white_check_mark: Validation status: passed

File
Status
Preview URL
Details
Dependent Files

split/updateTestRef.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Baichuan-13B-Base微调loss scale到1报错

配置：8*V100-32G 采用zero2进行微调
是否是模型文件本身的问题呢？这个情况时有时无
[INFO|trainer.py:1712] 2023-09-15 14:11:29,617 >> ***** Running training *****
[INFO|trainer.py:1713] 2023-09-15 14:11:29,617 >>   Num examples = 3,547
[INFO|trainer.py:1714] 2023-09-15 14:11:29,617 >>   Num Epochs = 5
[INFO|trainer.py:1715] 2023-09-15 14:11:29,618 >>   Instantaneous batch size per device = 4
[INFO|trainer.py:1718] 2023-09-15 14:11:29,618 >>   Total train batch size (w. parallel, distributed & accumulation) = 64
[INFO|trainer.py:1719] 2023-09-15 14:11:29,618 >>   Gradient Accumulation steps = 4
[INFO|trainer.py:1720] 2023-09-15 14:11:29,618 >>   Total optimization steps = 275
[INFO|trainer.py:1721] 2023-09-15 14:11:29,623 >>   Number of trainable parameters = 55,787,520
09/15/2023 14:11:29 - WARNING - llmtuner.extras.callbacks - Previous log file in this folder will be deleted.
0%|                                                                                | 0/275 [00:00<?, ?it/s][2023-09-15 14:11:34,418] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale:<PHONE_NUMBER>, reducing to<PHONE_NUMBER>
0%|▎                                                                                | 1/275 [00:04<21:52,  4.79s/it][2023-09-15 14:11:37,245] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale:<PHONE_NUMBER>, reducing to<PHONE_NUMBER>
1%|▋                                                                                | 2/275 [00:07<16:32,  3.64s/it][2023-09-15 14:11:41,021] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale:<PHONE_NUMBER>, reducing to 536870912
1%|█                                                                                | 3/275 [00:11<16:46,  3.70s/it][2023-09-15 14:11:44,251] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 536870912, reducing to 268435456
1%|█▍                                                                                | 4/275 [00:14<15:53,  3.52s/it][2023-09-15 14:11:47,648] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 268435456, reducing to 134217728
2%|█▊                                                                                | 5/275 [00:18<15:37,  3.47s/it][2023-09-15 14:11:51,039] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 134217728, reducing to 67108864
2%|██▏                                                                                | 6/275 [00:21<15:26,  3.44s/it][2023-09-15 14:11:53,877] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 67108864, reducing to 33554432
3%|██▌                                                                                | 7/275 [00:24<14:30,  3.25s/it][2023-09-15 14:11:56,784] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 33554432, reducing to 16777216
3%|██▉                                                                                | 8/275 [00:27<13:58,  3.14s/it][2023-09-15 14:11:59,835] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 16777216, reducing to 8388608
3%|███▎                                                                                | 9/275 [00:30<13:46,  3.11s/it][2023-09-15 14:12:03,418] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 8388608, reducing to 4194304
{'loss': 10.1406, 'learning_rate': 5e-05, 'epoch': 0.18}
4%|███▋                                                                                | 10/275 [00:33<14:22,  3.25s/it][2023-09-15 14:12:06,663] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 4194304, reducing to 2097152
4%|████                                                                                | 11/275 [00:37<14:18,  3.25s/it][2023-09-15 14:12:09,679] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 2097152, reducing to 1048576
4%|████▎                                                                                | 12/275 [00:40<13:56,  3.18s/it][2023-09-15 14:12:12,679] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 1048576, reducing to 524288
5%|████▋                                                                                | 13/275 [00:43<13:39,  3.13s/it][2023-09-15 14:12:15,496] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 524288, reducing to 262144
5%|█████                                                                                | 14/275 [00:45<13:11,  3.03s/it][2023-09-15 14:12:18,667] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 262144, reducing to 131072
5%|█████▍                                                                                | 15/275 [00:49<13:19,  3.07s/it][2023-09-15 14:12:21,878] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 131072, reducing to 65536
6%|█████▊                                                                                | 16/275 [00:52<13:27,  3.12s/it][2023-09-15 14:12:24,969] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 65536, reducing to 32768
6%|██████▏                                                                                | 17/275 [00:55<13:21,  3.11s/it][2023-09-15 14:12:28,100] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 32768, reducing to 16384
7%|██████▌                                                                                | 18/275 [00:58<13:20,  3.12s/it][2023-09-15 14:12:30,970] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 16384, reducing to 8192
7%|██████▉                                                                                | 19/275 [01:01<12:58,  3.04s/it][2023-09-15 14:12:34,401] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 8192, reducing to 4096
{'loss': 10.1933, 'learning_rate': 5e-05, 'epoch': 0.36}
8%|███████▋                                                                                | 21/275 [01:07<12:52,  3.04s/it][2023-09-15 14:12:40,373] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 4096, reducing to 2048
8%|████████▎                                                                                | 23/275 [01:13<13:01,  3.10s/it][2023-09-15 14:12:46,872] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 2048, reducing to 1024
9%|████████▋                                                                                | 24/275 [01:17<13:18,  3.18s/it][2023-09-15 14:12:50,224] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 1024, reducing to 512
9%|█████████                                                                                | 25/275 [01:20<13:28,  3.23s/it][2023-09-15 14:12:53,112] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 512, reducing to 256
9%|█████████▍                                                                                | 26/275 [01:23<12:59,  3.13s/it][2023-09-15 14:12:56,189] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 256, reducing to 128
10%|█████████▊                                                                                | 27/275 [01:26<12:52,  3.11s/it][2023-09-15 14:12:59,683] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 128, reducing to 64
10%|██████████▏                                                                                | 28/275 [01:30<13:17,  3.23s/it][2023-09-15 14:13:03,052] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 64, reducing to 32
11%|██████████▌                                                                                | 29/275 [01:33<13:24,  3.27s/it][2023-09-15 14:13:06,502] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 32, reducing to 16
{'loss': 9.8252, 'learning_rate': 4.999347492558202e-05, 'epoch': 0.54}
11%|███████████▎                                                                                | 31/275 [01:39<12:54,  3.18s/it][2023-09-15 14:13:12,990] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 16, reducing to 8
12%|████████████                                                                                | 33/275 [01:46<13:01,  3.23s/it][2023-09-15 14:13:19,052] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 8, reducing to 4
13%|████████████▋                                                                                | 35/275 [01:52<12:33,  3.14s/it][2023-09-15 14:13:25,317] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 4, reducing to 2
13%|█████████████▍                                                                                | 37/275 [01:58<12:32,  3.16s/it][2023-09-15 14:13:31,499] [INFO] [loss_scaler.py:183:update_scale] [deepspeed] OVERFLOW! Rank 0 Skipping step. Attempted loss scale: 2, reducing to 1
14%|█████████████▊                                                                                | 38/275 [02:01<12:18,  3.12s/it]Traceback (most recent call last):
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/train_bash.py", line 14, in
Traceback (most recent call last):
Traceback (most recent call last):
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/train_bash.py", line 14, in
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/train_bash.py", line 14, in
Traceback (most recent call last):
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/train_bash.py", line 14, in
main()
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/train_bash.py", line 5, in main
main()main()
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/train_bash.py", line 5, in main
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/train_bash.py", line 5, in main
main()
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/train_bash.py", line 5, in main
run_exp()
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/llmtuner/tuner/tune.py", line 26, in run_exp
run_exp()run_exp()
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/llmtuner/tuner/tune.py", line 26, in run_exp
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/llmtuner/tuner/tune.py", line 26, in run_exp
run_exp()
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/llmtuner/tuner/tune.py", line 26, in run_exp
run_sft(model_args, data_args, training_args, finetuning_args, generating_args, callbacks)
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/llmtuner/tuner/sft/workflow.py", line 66, in run_sft
run_sft(model_args, data_args, training_args, finetuning_args, generating_args, callbacks)run_sft(model_args, data_args, training_args, finetuning_args, generating_args, callbacks)
run_sft(model_args, data_args, training_args, finetuning_args, generating_args, callbacks)
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/llmtuner/tuner/sft/workflow.py", line 66, in run_sft
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/llmtuner/tuner/sft/workflow.py", line 66, in run_sft
File "/mnt/workspace/algteam/mingjiao/LLaMA-Efficient-Tuning/src/llmtuner/tuner/sft/workflow.py", line 66, in run_sft
train_result = trainer.train(resume_from_checkpoint=training_args.resume_from_checkpoint)train_result = trainer.train(resume_from_checkpoint=training_args.resume_from_checkpoint)
File "/home/pai/lib/python3.9/site-packages/transformers/trainer.py", line 1553, in train
File "/home/pai/lib/python3.9/site-packages/transformers/trainer.py", line 1553, in train
train_result = trainer.train(resume_from_checkpoint=training_args.resume_from_checkpoint)
File "/home/pai/lib/python3.9/site-packages/transformers/trainer.py", line 1553, in train
train_result = trainer.train(resume_from_checkpoint=training_args.resume_from_checkpoint)
File "/home/pai/lib/python3.9/site-packages/transformers/trainer.py", line 1553, in train
return inner_training_loop(
File "/home/pai/lib/python3.9/site-packages/transformers/trainer.py", line 1835, in _inner_training_loop
return inner_training_loop(
File "/home/pai/lib/python3.9/site-packages/transformers/trainer.py", line 1835, in _inner_training_loop
return inner_training_loop(
File "/home/pai/lib/python3.9/site-packages/transformers/trainer.py", line 1835, in _inner_training_loop
return inner_training_loop(
File "/home/pai/lib/python3.9/site-packages/transformers/trainer.py", line 1835, in _inner_training_loop
tr_loss_step = self.training_step(model, inputs)
tr_loss_step = self.training_step(model, inputs)
File "/home/pai/lib/python3.9/site-packages/transformers/trainer.py", line 2690, in training_step
File "/home/pai/lib/python3.9/site-packages/transformers/trainer.py", line 2690, in training_step
tr_loss_step = self.training_step(model, inputs)
File "/home/pai/lib/python3.9/site-packages/transformers/trainer.py", line 2690, in training_step
tr_loss_step = self.training_step(model, inputs)
File "/home/pai/lib/python3.9/site-packages/transformers/trainer.py", line 2690, in training_step
self.accelerator.backward(loss)self.accelerator.backward(loss)
File "/home/pai/lib/python3.9/site-packages/accelerate/accelerator.py", line 1917, in backward
File "/home/pai/lib/python3.9/site-packages/accelerate/accelerator.py", line 1917, in backward
self.accelerator.backward(loss)
File "/home/pai/lib/python3.9/site-packages/accelerate/accelerator.py", line 1917, in backward
self.accelerator.backward(loss)
File "/home/pai/lib/python3.9/site-packages/accelerate/accelerator.py", line 1917, in backward
self.deepspeed_engine_wrapped.backward(loss, **kwargs)self.deepspeed_engine_wrapped.backward(loss, **kwargs)
File "/home/pai/lib/python3.9/site-packages/accelerate/utils/deepspeed.py", line 176, in backward
File "/home/pai/lib/python3.9/site-packages/accelerate/utils/deepspeed.py", line 176, in backward
self.deepspeed_engine_wrapped.backward(loss, **kwargs)
File "/home/pai/lib/python3.9/site-packages/accelerate/utils/deepspeed.py", line 176, in backward
self.deepspeed_engine_wrapped.backward(loss, **kwargs)
File "/home/pai/lib/python3.9/site-packages/accelerate/utils/deepspeed.py", line 176, in backward
self.engine.step()self.engine.step()
  File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/engine.py", line 2116, in step

self.engine.step()  File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/engine.py", line 2116, in step
self.engine.step()
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/engine.py", line 2116, in step
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/engine.py", line 2116, in step
self._take_model_step(lr_kwargs)
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/engine.py", line 2022, in _take_model_step
self._take_model_step(lr_kwargs)self._take_model_step(lr_kwargs)
self._take_model_step(lr_kwargs)  File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/engine.py", line 2022, in _take_model_step
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/engine.py", line 2022, in _take_model_step
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/engine.py", line 2022, in _take_model_step
self.optimizer.step()
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/zero/stage_1_and_2.py", line 1717, in step
self.optimizer.step()self.optimizer.step()
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/zero/stage_1_and_2.py", line 1717, in step
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/zero/stage_1_and_2.py", line 1717, in step
self.optimizer.step()
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/zero/stage_1_and_2.py", line 1717, in step
self._update_scale(self.overflow)
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/zero/stage_1_and_2.py", line 1968, in _update_scale
self._update_scale(self.overflow)self._update_scale(self.overflow)self._update_scale(self.overflow)
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/zero/stage_1_and_2.py", line 1968, in _update_scale
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/zero/stage_1_and_2.py", line 1968, in _update_scale
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/zero/stage_1_and_2.py", line 1968, in _update_scale
self.loss_scaler.update_scale(has_overflow)
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/fp16/loss_scaler.py", line 175, in update_scale
self.loss_scaler.update_scale(has_overflow)self.loss_scaler.update_scale(has_overflow)
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/fp16/loss_scaler.py", line 175, in update_scale
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/fp16/loss_scaler.py", line 175, in update_scale
self.loss_scaler.update_scale(has_overflow)
File "/home/pai/lib/python3.9/site-packages/deepspeed/runtime/fp16/loss_scaler.py", line 175, in update_scale
raise Exception(
Exception    : raise Exception(    raise Exception(Current loss scale already at minimum - cannot decrease scale anymore. Exiting run.
Exceptionraise Exception(Exception:
Current loss scale already at minimum - cannot decrease scale anymore. Exiting run.:
Current loss scale already at minimum - cannot decrease scale anymore. Exiting run.Exception
: Current loss scale already at minimum - cannot decrease scale anymore. Exiting run.
14%|█████████████▊                                                                                | 38/275 [02:05<13:02,  3.30s/it]
dsw64484-887cb56c8-r5vhm:10214:10954 [3] NCCL INFO [Service thread] Connection closed by localRank 3
dsw64484-887cb56c8-r5vhm:10213:10955 [2] NCCL INFO [Service thread] Connection closed by localRank 2
dsw64484-887cb56c8-r5vhm:10212:10953 [1] NCCL INFO [Service thread] Connection closed by localRank 1
dsw64484-887cb56c8-r5vhm:10211:10956 [0] NCCL INFO [Service thread] Connection closed by localRank 0
dsw64484-887cb56c8-r5vhm:10213:10213 [2] NCCL INFO comm 0x393946f0 rank 2 nranks 4 cudaDev 2 busId d0 - Abort COMPLETE
dsw64484-887cb56c8-r5vhm:10212:10212 [1] NCCL INFO comm 0x30f7bf90 rank 1 nranks 4 cudaDev 1 busId c0 - Abort COMPLETE
dsw64484-887cb56c8-r5vhm:10214:10214 [3] NCCL INFO comm 0x329c5d70 rank 3 nranks 4 cudaDev 3 busId f0 - Abort COMPLETE
dsw64484-887cb56c8-r5vhm:10211:10211 [0] NCCL INFO comm 0x31aaa080 rank 0 nranks 4 cudaDev 0 busId 90 - Abort COMPLETE
[2023-09-15 14:13:37,936] [INFO] [launch.py:315:sigkill_handler] Killing subprocess 10211
[2023-09-15 14:13:38,030] [INFO] [launch.py:315:sigkill_handler] Killing subprocess 10212
[2023-09-15 14:13:38,203] [INFO] [launch.py:315:sigkill_handler] Killing subprocess 10213
[2023-09-15 14:13:38,204] [INFO] [launch.py:315:sigkill_handler] Killing subprocess 10214

模型代码版本是最新的吗

用的是9.11号clone下来的

LoRA 的话可以试试不开启 DeepSpeed，用 accelerate 配置来启动

刚刚试了一下accelerate launch，似乎还是同样的报错，都是loss scale减到1

单卡能跑吗

单卡显存只有32G，会oom，所以采用的zero2来着

你解决这个问题了吗？我也遇到了

[ ] - [ ] - あなたが連絡できるかどうかはわかりません__[[[]()]()]()****


Arrow on evolutions going to the left

The arrow head on evolutions that go left is pointing the wrong way.

The arrow should point left.

Example:
component test [0.9, 0.2]
evolve test 0.1

Hi @johnhearn
My understanding is that components don't generally de-evolve so such a thing wouldn't appear on a wardley map. Is that the intent?
Of course @swardley would be the person to confirm.

That is correct. The only circumstance when something “de-evolves” is when competition is removed either through a monopoly or it has become redundant.
The far more common circumstance is when something is becoming a commodity BUT a vendor wishes it to remain a product or appear as custom built.  Hence the two main forms are:-

Something evolves to a more evolved state A -> A’

Vendor pretends something is less evolved B -> B’

Both are covered by the existing format:-
component A [0.49, 0.64]
component B [0.36, 0.61]
evolve A->A' 0.8
evolve B->B' 0.3
From: damonsk @.>
Sent: Friday, April 12, 2024 5:33 PM
To: damonsk/wardley-maps-examples @.>
Cc: swardley @.>; Mention @.>
Subject: Re: [damonsk/wardley-maps-examples] Arrow on evolutions going to the left (Issue #2)
Hi @johnhearn https://github.com/johnhearn
My understanding is that components don't generally de-evolve so such a thing wouldn't appear on a wardley map. Is that the intent?
Of course @swardley https://github.com/swardley  would be the person to confirm.
—
Reply to this email directly, view it on GitHub https://github.com/damonsk/wardley-maps-examples/issues/2#issuecomment-2052091438 , or unsubscribe https://github.com/notifications/unsubscribe-auth/ACAANE4JIJANN2BQE7UWAVLY5AEDPAVCNFSM6AAAAABF45W3L6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDANJSGA4TCNBTHA .
You are receiving this because you were mentioned.  https://github.com/notifications/beacon/ACAANE3IBLMJ7N4NAWSXUYTY5AEDPA5CNFSM6AAAAABF45W3L6WGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTT2KBXC4.gif Message ID: @.*** @.***> >

My situation is that my company wants to beat competition by gradually customising an existing product. How do I represent that?


How to pick directory Paths based on Build Agent Name in AzureDevops task

We have a requirement in Azuredevops task to pick the Tasks filesystem path (gradleHome), based on the agent.name as we have different kind of agents in the same pool.
I tried, below solution, but didn't work. It's not picking the gradleHome Pathas per the agent picked.
- task: Gradle@2
  displayName: 'Clean Project'
  inputs:
   workingDirectory: 'xxxx'
   gradleWrapperFile: '$(System.DefaultWorkingDirectory)/gradlew'
   javaHomeOption: 'JDKVersion'
   jdkVersionOption: '1.11'
   ${{ if startsWith(variables['Agent.Name'], 'mypool1')}}:
     tasks: 'clean <Commands> -Dgradle.user.home=/opt/gradle-8.0.2'
   ${{ if notIn(variables['Agent.Name'], 'azdevops-android-scaledjob')}}:
     tasks: 'clean <Commands> -Dgradle.user.home=/data/gradle'

Any method to achieve this using AzureDevops pipeline?

Hi @vivuu1989, this forum is available to discuss the concerns regarding Azuredevopslabs  site and  the content. Seems like your concern is not related to any of the labs. Please try finding the solution in the relevant forum.


Suggested documentation update

On Ubuntu 16.04 with Ansible 2.3, the install fails unless gather_facts: true is set.
The documentation should reflect this is required ... even if just in this case.

It's not caused by the role. You're hitting an Ansible issue itself. Even the
- hosts: all
  tasks:
    - ping:

Will fail. it's because Ubuntu 16.04 doesn't use Python2 which Ansible is set for default.
https://stackoverflow.com/questions/32429259/ansible-fails-with-bin-sh-1-usr-bin-python-not-found
Another valid solution:
ansible my_ubuntu_host -m ping -e 'ansible_python_interpreter=/usr/bin/python3'

Also by default gather_facts: true should be set. If it is not then your install of Ansible is broken.

# plays will gather facts by default, which contain information about
# the remote system.
#
# smart - gather by default, but don't regather if already gathered
# implicit - gather by default, turn off with gather_facts: False
# explicit - do not gather by default, must say gather_facts: True
#gathering = implicit

extracted from ansible.cfg

@ericsysmin, setting one of these other valid options in ansible.cfg merely makes it a non-default Ansible config. It does not make Ansible "broken".

Also, regarding "Ubuntu 16.04 doesn't use Python2" .. the recommended solution from the Ansible project is to install it .. as opposed to defining Python 3 as the Ansible Python interpreter. I don't currently see that anything has changed since that posting.


Map cycling button widget and cycling options

Turns out there are still like 2 other inner classes, but I will get em
Signed-off-by: liach<EMAIL_ADDRESS>

Requesting reviews. Imo this introduces some javadoc and makes cycling options much easier for mods to use, and only renames getGenericTextForValue, which should have a small impact.


Add 2.7.3 docs for repo

Signed-off-by: xiaolongran<EMAIL_ADDRESS>Fixes #10665
Motivation
Add 2.7.3 docs for repo
Modifications

Add 2.7.3 docs in versioned_docs
Add sidebars in versioned_sidebars
Update release.json
Update versions.json

@wolfstudy thanks for your contribution!
Seems that release.json and versions.json should be updated after 2.7.3 is released (at that time, 2.7.3 should be displayed on the website)
Take 2.7.2 for references: https://github.com/apache/pulsar/pull/10256#issuecomment-822506632 https://github.com/apache/pulsar/pull/10585
@Jennifer88huang @eolivelli please correct me if I'm wrong.

@wolfstudy great job. Thank you for taking the lead to do it.
@Anonymitaet Yes, you're correct.

@Anonymitaet @Jennifer88huang PTAL thanks.

@wolfstudy thanks for your contribution!
Seems that release.json and versions.json should be updated after 2.7.3 is released (at that time, 2.7.3 should be displayed on the website)
Take 2.7.2 for references:

#10256 (comment)
#10585

@Jennifer88huang @eolivelli please correct me if I'm wrong.

Yes, yu. The 2.7.3 has not yet been released, so we can temporarily use it as a historical document. After 2.7.3 is released, we will show it to users as the main version of the document.

The 2.7.3 has not yet been released, so we can temporarily use it as a historical document. After 2.7.3 is released, we will show it to users as the main version of the document.

I do not understand this comment, can you please explain ?
we must not list 2.7.3 in the menu

The 2.7.3 has not yet been released, so we can temporarily use it as a historical document. After 2.7.3 is released, we will show it to users as the main version of the document.

I do not understand this comment, can you please explain ?
we must not list 2.7.3 in the menu

Cool, will fix it, PTAL again.


On Linux  Md-ImgLocalize  creates MDPATH\Test.md

Given a directory called MDPATH that contains Test.md
After invoking python3 main.py --md_path ~/Desktop/MDPATH  --modify_source
the program does not modify Test.md
Instead it creates a file MDPATH\Test.md  alongside directory MDPATH rather than modifying Test.md inside the folder.
This looks like it's caused by a programming error. On Linux the forward slash / is the proper way to separate a directory from a filename. In this case the program is using \ which is very Windows-esque.

I'll solve this bug, thanks.

Fixed, thanks a lot.

After doing a git pull in the Md-ImgLocalize directory and retesting I can confirm that this issue is resolved - with thanks!
Let me therefore close this out.


wrapping for embedding in mobile and desktop apps

i know this is very high level but figured it was worth bring up here.
I have been looking into how we can make Desktop and Mobile apps and sign them too.
There are a few libs around to help, but no one has really brought it together yet.
I there any interest in this or idea how best to do it ?
My current thinking is...
Golang backend (on mobile):

use gomobile bind, and export a binary API.

Native webview (a bit of ios and android code):

This creates a the web view api, withe the right commands to expose it to the golang frontend as Javascript and back again.
The binary commands need to pass through so we don't have to write a tons of boiler plate ios and android code.

Golang frontend:

vecty etc, but essentially a big elect statement for each possible command statement and then route it appropriately.

It could be that protobufs are a perfect solution here because its binary and because there are very good code generators around it. Its probably too early to tell though.
Has anyone else looked into this ?

I can imagine a world in which Vecty might provide easy integration with a separate project that handles all of the difficult bits (i.e. a project that handles setting up a webview using Android/iOS/Electron APIs). This would primarily be some sort of 'vecty' CLI tool which would manage compiling go to js, packaging assets, etc.
As far as getting an actual cross-platform webview on android/ios/desktop.. that's obviously outside the scope of vecty itself. And I cannot imagine why such a project would be inherently tied to vecty, after all it should work with any HTML/JS/CSS code.

@slimsag your right - it should not be tied to vecty at all.
The Vecty CLi is a good way of putting it. Most of the code needed is a stuff to travel over the other languages.  This is because you want a DB down there and need data flowing between the UI and DB layer.
The other thing is just holding the webview.
At the moment i am getting good success with Ebiten. This is a 2D game engne but has good infrastructure for bring up and signing n all Desktops and Mobiles right now. Adding a Webview and the boiler plate signalling is a definite smart move.

@joeblew99 I have a feeling any game engine and web app in general will have very different setup requirements. I'm also not aware of any game engine in Go today that has a good mobile story (including gomobile, although that isn't really a game engine).
Today I was trying to achieve something like this issue with a Vecty app of my own, and what I considered is that having something which could:

Take a Vecty / GopherJS application as input and (2)
Produce a truly-cross-platform (Windows, Mac & Linux via Electron, Android & iOS via their native WebView's)

Would be quite nice. The tricky part is how to actually do that. The Mac and iOS parts introduce the most complexity, mainly because you must have a mac to develop for those generally. It'd be great if that wasn't the case.
I think what we could do is one of two things:

Ask for users to download the mac installer from the app store, and then start and control a mac virtual machine on their own hardware via qemu with KVM extension, inside of a docker container so there would be basically no work involved. https://github.com/Cleafy/sxkdvm is one such project which does this (we would just need to write the actual application packaging on top of this).
Easier, if we can get away with it in all aspects, offer a Docker image which could package for each OS respectively. This would mean:
Windows/Mac/Linux would be packaged via https://www.npmjs.com/package/electron-packager inside the Docker image.
Because Docker only runs Linux, we would have to try getting https://github.com/saucelabs/isign to work with signing the Mac & iOS applications.
For Android and iOS, we would build an application which would essentially just be a webview + packaged up index.html and bundle.js file (+ maybe other assets?), and would expose whatever APIs we wanted (e.g. to create notifications). We would then save this as an apk or app file, and the Docker image itself would only open this file, replace the relevant information (settings files regarding app name & author info etc, and data files like index.html and bundle.js) and then sign the file once again using the relevant certificate.

In theory what this would be like is essentially having a user install Docker first and then run:
vecty package ./my/go/package

And it producing an app file for every important desktop + mobile OS.
Nothing concrete here, maybe there are obvious issues I am missing, but if we could get that to work I think it'd be a great thing to include in a Vecty CLI tool in the long run.


SDFE-10202 Protect the 'immutable' types in the Value class

The type and next properties on net.sf.joost.stx.Value were publicly mutable. What this meant is that the following static values:

VAL_TRUE
VAL_FALSE
VAL_EMPTY
VAL_EMPTY_STRING
VAL_ZERO
VAL_NAN

could accidentally be mutated. This is most noticable when you're using sequences of immutable types like true(), ie:
<stx:variable name="my-seq" select="(true(), false(), true())"/>

The problem here is that functions like insert-before() will mutate the values of the sequence, ergo mutating the immutable instances. Mutation of the sequence is expected, however mutation of the immutable values declared is an unexpected side-effect.
It gets somewhat worse in that functions like index-of will also mutate parameters. So if you have a statement like:
<stx:variable name="my-true-values" select="index-of($my-seq, true())"/>

Then the index-of function will attempt to mutate the next property of your second parameter true(), which should be immutable. It attempts to set next to null, which we expect. So this is not too bad. It shouldn't happen though.

Well, the fix was supposed to be "quick". Without getting into a deeper refactoring of STX, which I don't have time for right now, not sure of the best way to go about it. Any suggestions?


remove environment-highlight color setting

This setting allows users to chose where to display a color (left/top border etc.) based on the selected environment but this won't exist in the new designs.
This PR simplifies the design for selected/linked environments by removing it.

heads up, bootstrap fails:
Error: insomnia: [sr:types] src/models/settings.ts(45,5): error TS2322: Type '{ autoDetectColorScheme: false; autoHideMenuBar: false; autocompleteDelay: number; allowNotificationRequests: true; clearOAuth2SessionOnRestart: true; darkTheme: string; deviceId: null; ... 42 more ...; validateSSL: true; }' is not assignable to type 'Settings'.
insomnia: [sr:types]   Object literal may only specify known properties, and 'environmentHighlightColorStyle' does not exist in type 'Settings'.

Please put this feature back. It was usefull in case of multiple environments. Important environments was marked with RED to make obvious that i have important environment selected and do not call incorrect calls on it.


add the required padding

🛠 Issue (Number)

Closes #1828
Description
add the required padding
Type of change

[x] Bug fix (non-breaking change which fixes an issue)

Checklist:

[x] I have made this from my own
[x] My code follows the style guidelines of this project
[x] I have performed a self-review of my own code
[x] My changes generate no new warnings
[x] The title of my pull request is a short description of the requested changes.

ATTACH SCREEN-SHOTS / DEPLOYMENT LINK

@TusharKesarwani @zugzwang03 @harshit-paneri Kindly approve the changes.
Thanks!


option to force DLSS?

Im running cyberpunk on linux
i have an RTX 2060 that supports DLSS
but the settings are greyed out, anyway you can force these?

i tried adding this to the user.ini and it does not work
[DLSS]
Enable = true
EnableMirrorScaling = true
MirrorScaling = -1.000000
Quality = 2
Sharpness = 0.000000

just wondering do have integrated gpu on by any chance?
it seems to be a common issue in the game based on sources:
https://www.nvidia.com/en-us/geforce/forums/geforce-graphics-cards/5/418705/cant-enable-dlss-in-cyberpunk-2077-on-rtx-2060-but/
https://linustechtips.com/topic/1280727-dlss-on-my-rtx-2060-is-not-working-in-any-game-can-anyone-help-me/

I have no integrated gpu, my cpu is intel i9-9900KF (KF = no on board graphics)

It maybe some driver issue on linux. Can you enable it on other games?

It maybe some driver issue on linux. Can you enable it on other games?

This is a Windows issue and effects more than just this game.  For whatever reason some games just don't register that a GPU supports DLSS and will either grey out or won't show the DLSS options.

Not a Cyberpunk issue. From my understanding, although DLSS is natively supported on Linux, it only functions with native Linux games, and not games run through Wine/Proton.


Accessibility issue 11372 resolved aria label

This is the fixed for the issue #11372. I have removed both the aria-label and title.
Tests are working fine.

Please check the following:

[ ] Do the tests still pass?[^1]
[ ] Does the code comply with the style guide?

[ ] Run make lint from the Wagtail root.

[ ] For Python changes: Have you added tests to cover the new/fixed behaviour?
[ ] For front-end changes: Did you test on all of Wagtail’s supported environments?[^2]

[ ] Please list the exact browser and operating system versions you tested:
[ ] Please list which assistive technologies [^3] you tested:

[ ] For new features: Has the documentation been updated accordingly?

Please describe additional details for testing this change.
[^1]: Development Testing
[^2]: Browser and device support
[^3]: Accessibility Target

@thibaudcolas Is this alright?

@nandini584 can you look at the CI failure. Looks like an integration test also needs updating as it's looking for the aria-label.

Sure i will check this out @lb-

There's some issue that I am facing here, my tests are passing tho.

I have just pushed a change const trigger = await page.$('.sidebar-footer > button'); for the integration tests.

OK I think there's an issue with this test, and it's probably the reason aria-label was added in the first place.
@nandini584  I think for now you can simply remove this integration test for the sake of this PR, the button 100% has a label.
We can then raise a new issue for reinstating that integration test or reviewing how the axe tests work.
cc @thibaudcolas
 FAIL  client/tests/integration/homepage.test.js
  ● Homepage › axe sidebar footer

    expect(received).toPassAxeTests(expected)

    Expected page to pass Axe accessibility tests.
    Violations found:
    Rule: "button-name" (Buttons must have discernible text)
    Help: https://dequeuniversity.com/rules/axe/4.3/button-name?application=axe-puppeteer
    Affected Nodes:
      .w-px-4
        Fix ANY of the following:
        - Element does not have inner text that is visible to screen readers
        - aria-label attribute does not exist or is empty
        - aria-labelledby attribute does not exist, references elements that do not exist or references elements that are empty
        - Element has no title attribute
        - Element's default semantics were not overridden with role="none" or role="presentation"

      41 |     const trigger = await page.$('.sidebar-footer > button');
      42 |     await trigger.click();
    > 43 |     await expect(page).toPassAxeTests({
         |                        ^
      44 |       include: '.sidebar-footer',
      45 |     });
      46 |   });

      at Object.<anonymous> (homepage.test.js:43:24)

ok @lb- I have removed this particular test for now

Integration test issue has been flagged here https://github.com/wagtail/wagtail/issues/8938#issuecomment-1894834381


BUG: How to assign the modal anaylisis with Python

Good morning,
With my code in Python, I can't put ModalAnalysisSettings as I do with StaticAnalysisSettings.
Is there any function to do the modal analysis with Python ?
Tkank you very much for your answers !

Hi @IcareIbnFirnas,
again the script needs to be provided to check if everything works as it should. Web Services tend to be very particular regarding types of the values.

Hello @OndraMichal , where can I send you my script ?

Actually, the problem is that I can define : Loadcase.StaticAnalysis but there is no key work for ModalAnalysis in the script of Loadcase present here : RFEM_Python_Client-main\RFEM\LoadCasesAndCombinations


[Bug] Clicking The Text for a Category Only Selects "Asset Importing Tweaks"

Just so you have it noted down if needed
https://i.serealia.ca/puGE3/paHAfOqA30.webm/raw.webm

Oh I never noticed that, good catch. I will look into it, thanks.


Linked Pull Request Not Closed On Expired Task

This should be diagnosed and fixed.

@wannacfuture - Releasing the bounty back to dev pool because the allocated duration already ended!
Last activity time: Fri Aug 18 2023 23:07:15 GMT+0000 (Coordinated Universal Time)

Originally posted by @ubiquibot in https://github.com/ubiquity/ubiquibot/issues/431#issuecomment-1694037026

Does this mean that the bot should close the pr of the assignee whose deadline is ended?

Related #716

I think looping all open PRs on every issue closed is pretty expensive, i see there is a function to directly get linked PR from issue and close
gitIssueParser, its not in use currently.. any reason? @pavlovcik @0xcodercrane

/start

I think looping all open PRs on every issue closed is pretty expensive, i see there is a function to directly get linked PR from issue and close
gitIssueParser, its not in use currently.. any reason? @pavlovcik @0xcodercrane

Currently it is being improved for incentives for pr reviewers feature. 'll finish till today evening.

Do you have any updates @seprintour? If you would like to release the bounty back to the DevPool, please comment /stop
Last activity time: Mon Sep 11 2023 06:05:40 GMT+0000 (Coordinated Universal Time)

Awaiting review @pavlovcik @whilefoo


Add HMM_Mat4ToQuaternion

Adds a function to grab a quaternion from a rotation matrix. This resolves #85 and provides a way to convert a LookAt matrix to a quaternion.
I looked at whether I could also make a special, more optimized case for generating a LookAt quaternion, but given that LookAt can generate any arbitrary rotation, I couldn't find any easy opportunities for optimization. Maybe @RandyGaul has some magic solution, but this will at least work :)
The diff for this is completely insane, because I added that test coverage stuff. Sorry about that.

Haven't even started the review yet, but next time lets make this 2 PRs

I admit it got a little out of hand

You know what, yeah. Let me yank all of the test coverage stuff into its own branch.

Easy review now. I moved the coverage stuff to its own branch, which is in PR #104. Don't bother reviewing that until this is good.

Just need to clean up the code to follow some of our standards, the logic and implementation seems fine though


Docs: Add an example on how to monitor network traffic

I am adding an example on how to monitor incoming and outgoing network traffic. I think this is useful for people building crawlers.
No other changes added.

Hi @mxschmitt the firefox execution failed so I triggered the pipeline again. But it requires approval.

@mxschmitt Hey, coming back to this. Is this ready to be merged now?