keras is using tensorflow backend while running thru terminal but trying to use theano while running thru pycharm console

Description:
A. Open Anaconda prompt and run following commands:

activate <my_environment_name>
set "KERAS_BACKEND=tensorflow"
python
import keras
Output (as expected):
Using TensorFlow backend.

B. Open python console thru pycharm (which use the python.exe of the environment from A. as interpreter) and run following command:

import keras
Output (failed):

Using Theano backend.
Traceback (most recent call last):
  File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\gof\lazylinker_c.py", line 81, in <module>
    actual_version, force_compile, _need_reload))
ImportError: Version check of the existing lazylinker compiled file. Looking for version 0.211, but found None. Extra debug information: force_compile=False, _need_reload=True

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\gof\lazylinker_c.py", line 105, in <module>
    actual_version, force_compile, _need_reload))
ImportError: Version check of the existing lazylinker compiled file. Looking for version 0.211, but found None. Extra debug information: force_compile=False, _need_reload=True

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
You can find the C code in this temporary file: C:\Users\Ido\AppData\Local\Temp\theano_compilation_error_kkg8qfej
  File "C:\Program Files\JetBrains\PyCharm Community Edition 2019.2\helpers\pydev\pydevd.py", line 2060, in <module>
    main()
  File "C:\Program Files\JetBrains\PyCharm Community Edition 2019.2\helpers\pydev\pydevd.py", line 2054, in main
    globals = debugger.run(setup['file'], None, None, is_module)
  File "C:\Program Files\JetBrains\PyCharm Community Edition 2019.2\helpers\pydev\pydevd.py", line 1405, in run
    return self._exec(is_module, entry_point_fn, module_name, file, globals, locals)
  File "C:\Program Files\JetBrains\PyCharm Community Edition 2019.2\helpers\pydev\pydevd.py", line 1412, in _exec
    pydev_imports.execfile(file, globals, locals)  # execute the script
  File "C:\Program Files\JetBrains\PyCharm Community Edition 2019.2\helpers\pydev\_pydev_imps\_pydev_execfile.py", line 18, in execfile
    exec(compile(contents+"\n", file, 'exec'), glob, loc)
  File "C:/Users/Ido/Documents/Products/ABI_product/Codes/src/nba_py_learning/real_time_predictions.py", line 1, in <module>
    import keras
  File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\keras\__init__.py", line 3, in <module>
    from . import utils
  File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\keras\utils\__init__.py", line 6, in <module>
    from . import conv_utils
  File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\keras\utils\conv_utils.py", line 9, in <module>
    from .. import backend as K
  File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\keras\backend\__init__.py", line 86, in <module>
    from .theano_backend import *
  File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\keras\backend\theano_backend.py", line 7, in <module>
    import theano
  File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\__init__.py", line 110, in <module>
    from theano.compile import (
  File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\compile\__init__.py", line 12, in <module>
    from theano.compile.mode import *
  File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\compile\mode.py", line 11, in <module>
    import theano.gof.vm
  File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\gof\vm.py", line 674, in <module>
    from . import lazylinker_c
  File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\gof\lazylinker_c.py", line 140, in <module>
    preargs=args)
  File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\gof\cmodule.py", line 2396, in compile_str
    (status, compile_stderr.replace('\n', '. ')))
.

Process finished with exit code 1

OS: Windows 10
(base) anaconda version: 5.2.0 (run: conda list anaconda$ thru anaconda prompt)
(<my_environment_name>) anaconda version: "custom" (run: conda list anaconda$ thru anaconda prompt)
python: 3.6.8
tensorflow: 1.13.1
Keras: 2.2.4
*Note-
If I set the backend in the file .keras.json it works as expected in the python console of pycharm , but since I have 2 environments (one of python 2.7 and the other of python 3.6) I am looking for efficient approach to run projects on those different environments (one using theano and the other using tensorflow).

I guess you are used something like conda. Then I guess you use a different environment when using pycharm compared to console. Solution: configure your env. in pycharm.

Am 10.08.2019 um 01:47 schrieb idohi<EMAIL_ADDRESS>Description:
A. Open Anaconda prompt and run following command:
activate <my_environment_name>
set "KERAS_BACKEND=tensorflow"
python
import keras
Output (as expected):
Using TensorFlow backend.
B. Open python console thru pycharm (which use the python.exe of the environment from A. as interpreter) and run following command:
import keras
Output (failed):
Using Theano backend.
Traceback (most recent call last):
File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\gof\lazylinker_c.py", line 81, in
actual_version, force_compile, _need_reload))
ImportError: Version check of the existing lazylinker compiled file. Looking for version 0.211, but found None. Extra debug information: force_compile=False, _need_reload=True
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\gof\lazylinker_c.py", line 105, in
actual_version, force_compile, _need_reload))
ImportError: Version check of the existing lazylinker compiled file. Looking for version 0.211, but found None. Extra debug information: force_compile=False, _need_reload=True
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
You can find the C code in this temporary file: C:\Users\Ido\AppData\Local\Temp\theano_compilation_error_kkg8qfej
File "C:\Program Files\JetBrains\PyCharm Community Edition 2019.2\helpers\pydev\pydevd.py", line 2060, in
main()
File "C:\Program Files\JetBrains\PyCharm Community Edition 2019.2\helpers\pydev\pydevd.py", line 2054, in main
globals = debugger.run(setup['file'], None, None, is_module)
File "C:\Program Files\JetBrains\PyCharm Community Edition 2019.2\helpers\pydev\pydevd.py", line 1405, in run
return self.exec(is_module, entry_point_fn, module_name, file, globals, locals)
File "C:\Program Files\JetBrains\PyCharm Community Edition 2019.2\helpers\pydev\pydevd.py", line 1412, in exec
pydev_imports.execfile(file, globals, locals)  # execute the script
File "C:\Program Files\JetBrains\PyCharm Community Edition 2019.2\helpers\pydev_pydev_imps_pydev_execfile.py", line 18, in execfile
exec(compile(contents+"\n", file, 'exec'), glob, loc)
File "C:/Users/Ido/Documents/Products/ABI_product/Codes/src/nba_py_learning/real_time_predictions.py", line 1, in
import keras
File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\keras_init.py", line 3, in
from . import utils
File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\keras\utils_init.py", line 6, in
from . import conv_utils
File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\keras\utils\conv_utils.py", line 9, in
from .. import backend as K
File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\keras\backend_init_.py", line 86, in
from .theano_backend import *
File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\keras\backend\theano_backend.py", line 7, in
import theano
File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano_init_.py", line 110, in
from theano.compile import (
File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\compile_init_.py", line 12, in
from theano.compile.mode import *
File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\compile\mode.py", line 11, in
import theano.gof.vm
File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\gof\vm.py", line 674, in
from . import lazylinker_c
File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\gof\lazylinker_c.py", line 140, in
preargs=args)
File "C:\Users\Ido\AppData\Local\conda\conda\envs\py36\lib\site-packages\theano\gof\cmodule.py", line 2396, in compile_str
(status, compile_stderr.replace('\n', '. ')))
.
Process finished with exit code 1
OS: Windows 10
(base) anaconda version: 5.2.0 (run: conda list anaconda$ thru anaconda prompt)
(<my_environment_name>) anaconda version: "custom" (run: conda list anaconda$ thru anaconda prompt)
python: 3.6.8
tensorflow: 1.13.1
Keras: 2.2.4
—
You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub, or mute the thread.


Receipt error handling

Describe the feature
It is possible to handle receipts this way:
 stompConnection.send(
                "topic",
                Buffer.buffer(message.payload)
        ) { frame ->
            // only on success
        }

For my use case I want that ERROR is handled directly. But the only way how I see it working is to add a frame handler to intercept the RECEIPT that is generated, create errorHandler and track the receipt id.
Use cases
In order to give fast feedback to the user it would be nice if this could be handled by the library.
Contribution
I can contribute to this, but first it should be clear what is the best approach.

An approach could be to add receiptHandler on StompClientConnection.
When no value is passed it will use the current implementation.


⚠ Bofrost.com has degraded performance

In 2306e0b, Bofrost.com (https://www.bofrost.com) experienced degraded performance:

HTTP code: 200
Response time: 450 ms

Resolved: Bofrost.com performance has improved in ef609f0.


FAQ: How do I receive mobile push notification if my IT policy requires the use of a corporate proxy server?

This document also includes some other supporting changes, such as adding a short FAQ on pre-proxy and post-proxy relays.

Merging, thanks for all the reviews thus far,


Update gamepad extension

Add "Any" to the parameters of the direction for the condition Stick pushed in a direction.
Change wording to PascalCase for inputs name  (only cosmetic).

I need you @Silver-Streak & @tristanbob to double check, (I checked on my side)
Tell me if you get a regression with this new version 0.3.0 in an existing project.
See the changelog in my first post.

I tested this on an old project and a new one, and it worked great.

I use the controller type detection in my main game to determine whether it displays Xbox or PS4 button prompts. I'll test with this and report back if anything behaves oddly.


UnhandledPromiseRejectionWarning: Error: ENOENT: no such file or directory, open '/usr/local/lib/node_modules/vue-sfc-rollup/templates/library/.gitignore

I just ran into this error when running sfc-init:
$ sfc-init
✔ Which version of Vue are you writing for? › Vue 2
✔ Is this a single component or a library? › Library
✔ What is the npm name of your library? … vuepress-plugin-typesense-search
✔ Will this library be written in JavaScript or TypeScript? › JavaScript
✔ Enter a location to save the library files: … ./vuepress-plugin-typesense-search
(node:86758) UnhandledPromiseRejectionWarning: Error: ENOENT: no such file or directory, open '/usr/local/lib/node_modules/vue-sfc-rollup/templates/library/.gitignore'
    at Object.openSync (fs.js:498:3)
    at Object.readFileSync (fs.js:394:35)
    at /usr/local/lib/node_modules/vue-sfc-rollup/sfc-init.js:284:21
    at Array.forEach (<anonymous>)
    at scaffold (/usr/local/lib/node_modules/vue-sfc-rollup/sfc-init.js:260:15)
    at /usr/local/lib/node_modules/vue-sfc-rollup/sfc-init.js:324:5
    at processTicksAndRejections (internal/process/task_queues.js:95:5)
(Use `node --trace-warnings ...` to show where the warning was created)
(node:86758) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). To terminate the node process on unhandled promise rejection, use the CLI flag `--unhandled-rejections=strict` (see https://nodejs.org/api/cli.html#cli_unhandled_rejections_mode). (rejection id: 1)
(node:86758) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.

$ cat /usr/local/lib/node_modules/vue-sfc-rollup/templates/library/.gitignore
cat: /usr/local/lib/node_modules/vue-sfc-rollup/templates/library/.gitignore: No such file or directory

$ $ ls -al /usr/local/lib/node_modules/vue-sfc-rollup/templates/library/
total 28
drwxr-xr-x 12 jason  384 Jul 23 12:11 .
drwxr-xr-x  4 jason  128 Jul 23 12:11 ..
-rw-r--r--  1 jason   46 Oct 26  1985 .browserslistrc
-rw-r--r--  1 jason  216 Oct 26  1985 .npmignore
-rw-r--r--  1 jason  470 Oct 26  1985 babel.config.js
drwxr-xr-x  3 jason   96 Jul 23 12:11 build
drwxr-xr-x  4 jason  128 Jul 23 12:11 dev
-rw-r--r--  1 jason 2540 Oct 26  1985 library-package.json
-rw-r--r--  1 jason  305 Oct 26  1985 shims-tsx.d.ts
-rw-r--r--  1 jason  246 Oct 26  1985 shims-vue.d.ts
drwxr-xr-x  5 jason  160 Jul 23 12:11 src
-rw-r--r--  1 jason 1008 Oct 26  1985 tsconfig.json

I'm using the latest published version v4.1.0. It looks like the .gitignore template file didn't make it into the published npm package?

Thanks for reporting this! I've seen this happen before, where npm won't publish certain files, even in subdirectories. Will get a fix out ASAP.

Fix is out on npm.

Closing, updated repo with 4.1.1 code


Custom exceptions instead of exception handling

now we doing something like this:
throw new ResourceAlreadyExistsException(...);

and we do support exception handling via Spring Exception Handlers:
https://github.com/tracehubpm/pmo/blob/385414f0755d33204370b03d4078fc53170bd26a/src/main/java/git/tracehub/pmo/controller/AdviceController.java#L76-L87
We actually can get rid of this by making all our custom exceptions extend HttpStatusException. After this all of them will be handled by Spring
@hizmailovich wdyt?

But for now our custom exceptions are already inherited from ResponseStatusException. Why would it be better to replace it with HttpStatusException? We will still need to handle it in ControllerAdvice...

@hizmailovich If we do inherit HttpStatusException then we can remove Exception Handling inside ControllerAdvice


Code bug

In trainer_contrastive.py line129
feat = this_feat[:, perm[:K]] should be
idxs_perm = idxs[perm]
feat = this_feat[:,idxs_perm[:K]].squeeze()
Otherwise, it can not select the current points.

In trainer_contrastive.py line129 feat = this_feat[:, perm[:K]] should be idxs_perm = idxs[perm] feat = this_feat[:,idxs_perm[:K]].squeeze()
Otherwise, it can not select the current points.

Hello, I would like to consult you about some problems related to code reproduction. If possible, can I get your contact information


An old question that we always meet

Now, we create 5000 clients  every second to visit our  php service, which uses  seaweedfs to store images.
Three DELL servers have constructed a perfect image service,
after one day test, We found seaweed state  down,
when seaweed works well for a period after its start,  It always breaks down, and we don't know the reason....
curl <IP_ADDRESS>:9333/dir/status?pretty=y
{
"Topology": {
"DataCenters": null,
"Free": 0,
"Max": 0,
"layouts": null
},
"Version": "0.74"
}
ps -ef|grep weed
root       2810      1  0 Jul03 ?        00:02:35 /usr/local/sunlight/weed -log_dir=/var/log/weed server -ip <IP_ADDRESS> -master.port=9333 -master.defaultReplicaPlacement=001 -dir=/var/www/weedfs -volume.port=8180 -volume.max=10 -master.peers=<IP_ADDRESS>:9333,<IP_ADDRESS>:9333 2
seaweed log:
cat  weed.linux-A1.root.log.INFO.20170703-151026.2810
Log file created at: 2017/07/03 15:10:26
Running on machine: linux-A1
Binary: Built with gc devel +c1730ae Wed Jan 18 15:40:33 2017 +0000 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss threadid file:line] msg
I0703 15:10:26  2810 file_util.go:20] Folder /var/www/weedfs Permission: -rwxrwxrwx
I0703 15:10:26  2810 file_util.go:20] Folder /var/www/weedfs Permission: -rwxrwxrwx
I0703 15:10:26  2810 topology.go:81] Using default configurations.
I0703 15:10:26  2810 master_server.go:67] Volume Size Limit is 30000 MB
I0703 15:10:26  2810 server.go:217] Start Seaweed Master 0.74 at <IP_ADDRESS>:9333
I0703 15:10:27  2810 raft_server.go:56] Peers Change: [<IP_ADDRESS>:9333] => [<IP_ADDRESS>:9333 <IP_ADDRESS>:9333]
I0703 15:10:27  2810 raft_server.go:78] Joining cluster: <IP_ADDRESS>:9333,<IP_ADDRESS>:9333
I0703 15:10:27  2810 raft_server.go:166] Attempting to connect to: http://<IP_ADDRESS>:9333/cluster/join
I0703 15:10:30  2810 raft_server.go:171] Post returned error:  Post http://<IP_ADDRESS>:9333/cluster/join: dial tcp <IP_ADDRESS>:9333: getsockopt: no route to host
I0703 15:10:30  2810 raft_server.go:166] Attempting to connect to: http://<IP_ADDRESS>:9333/cluster/join
I0703 15:10:31  2810 raft_server.go:211] Post returned status:  200
I0703 15:10:31  2810 volume_loading.go:73] loading index file /var/www/weedfs/3.idx readonly false
I0703 15:10:31  2810 disk_location.go:44] data file /var/www/weedfs/3.dat, replicaPlacement=001 v=2 size=19233384 ttl=
I0703 15:10:31  2810 disk_location.go:97] Store started on dir: /var/www/weedfs with 1 volumes max 10
I0703 15:10:31  2810 server.go:290] Start Seaweed volume server 0.74 at <IP_ADDRESS>:8180
I0703 15:10:31  2810 volume_grpc_client.go:17] Volume server bootstraps with master <IP_ADDRESS>:9333
I0703 15:10:31  2810 volume_grpc_client.go:25] heartbeat error: No master found: No master node available!
I0703 15:10:36  2810 volume_grpc_client.go:52] Heartbeat to <IP_ADDRESS>:9333
I0705 19:44:13  2810 master_server.go:96] [ <IP_ADDRESS>:9333 ] <IP_ADDRESS>:9333 becomes leader.

The elected master is "<IP_ADDRESS>:9333", what's the output of this?
curl <IP_ADDRESS>:9333/dir/status?pretty=y

I suppose this "heartbeat error: No master found: No master node available!" problem is resolved in latest commits.


AddRouting IServiceCollection extension should be in Microsoft.Framework.DependencyInjection namespace like other extensions

https://github.com/aspnet/Routing/blob/dev/src/Microsoft.AspNet.Routing/RoutingServices.cs#L10

Merged : https://github.com/aspnet/Routing/commit/61e4f55075adf637356f4008765dff3f4bb3f367


az policy set-definition create --params doesn't upload strongType and assignPermissions value from parameter metadata

This is autogenerated. Please review and update as needed.
Describe the bug
Command Name
az policy set-definition create
Errors:
No CLI Error as such. The command executes successfully. But azure portal doesn't show the all the parameter metadata attributes.
To Reproduce:
Steps to reproduce the behavior. Note that argument values have been redacted, as they may contain sensitive information.

Create a policy defintion which accepts a "logAnalytics" parameter which is a path of log analytics workspace
Create an initiave with above policy definition and a "logAnalytics" parameter which is a path of log analytics workspace
During assignment of initiative, as we want the log analytics to be shown as a drop down, we specify the strongType metadata as for this parameter in both policy and in initiative as below
    "parameters": {     "logAnalytics": {       "type": "String",       "metadata": {         "displayName": "Log Analytics workspace",         "description": "Select Log Analytics workspace from dropdown list. If this workspace is outside of the scope of the assignment you must manually grant 'Log Analytics Contributor' permissions (or similar) to the policy assignment's principal ID.",         "strongType": "omsWorkspace",         "assignPermissions": true       }     }   },
Then we deploy the policy definition using az policy command on a subscription and try to assign it in Azure Portal. But it won't show the drop down in parameters.
Then we deploy the initiative using below command on a subscription and try to assign it in Azure Portal. But it won't show the drop down in parameters.
az policy set-definition create --name "deploy-diagsetting-loganalytics" --description "Deploys diagnostic settings policy for all supported resources" --display-name "deploy-diagsetting-loganalytics" --metadata category=Monitoring version=1.0.0 --params "{"logAnalytics":{"type":"String","metadata":{"displayName":"Log Analytics workspace","description":"Select Log Analytics workspace from dropdown list. If this workspace is outside of the scope of the assignment you must manually grant 'Log Analytics Contributor' permissions (or similar) to the policy assignment's principal ID.","strongType":"Microsoft.OperationalInsights/workspaces","assignPermissions":true}}}" --definitions "[{"policyDefinitionId":"/subscriptions/513322cc-b0bd-455e-954c-ef9881649f47/providers/Microsoft.Authorization/policyDefinitions/deploy-afd-diagsetting","parameters":{"logAnalytics":{"value":"[parameters('logAnalytics')]"}},"groupNames":[]}]" --subscription "513322cc-b0bd-455e-954c-ef9881649f47"

Expected Behavior

Both Policy and Policy intiative should show log analytics drop down in its parameter when the strongType is specified either "omsWorkspace" or "Microsoft.OperationalInsights/workspaces"

Environment Summary
macOS-11.2.2-x86_64-i386-64bit
Python 3.8.8
Installer: HOMEBREW

azure-cli 2.19.1 *

This also happens when azure pipeline executes the above steps on a VM with vmImage: 'ubuntu-18.04'
Additional Context

After deploying when we export the policy/intiative definition back, it doesn't contain the below attributes from the parameter metadata: strongType, assignPermissions

@zhoxing-ms
The steps are already mentioned in To Reproduce section of this issue.
@yonzhan any update on this?

@ishangajera-crest In fact, I'd like to know what parameters you use to create this policy definition

"policyDefinitionId":"/subscriptions/513322cc-b0bd-455e-954c-ef9881649f47/providers/Microsoft.Authorization/policyDefinitions/deploy-afd-diagsetting

@zhoxing-ms  All the parameters of the Policy Set are also used and defined exactly same in the Policy definition as well.
"parameters": { "logAnalytics": { "type": "String", "metadata": { "displayName": "Log Analytics workspace", "description": "Select Log Analytics workspace from dropdown list. If this workspace is outside of the scope of the assignment you must manually grant 'Log Analytics Contributor' permissions (or similar) to the policy assignment's principal ID.", "strongType": "omsWorkspace", "assignPermissions": true } } },

@zhoxing-ms All the parameters of the Policy Set are also used and defined exactly same in the Policy definition as well.
"parameters": { "logAnalytics": { "type": "String", "metadata": { "displayName": "Log Analytics workspace", "description": "Select Log Analytics workspace from dropdown list. If this workspace is outside of the scope of the assignment you must manually grant 'Log Analytics Contributor' permissions (or similar) to the policy assignment's principal ID.", "strongType": "omsWorkspace", "assignPermissions": true } } },

@ishangajera-crest What about the rules used by this policy definition? I would like to create the same resources to reproduce this issue


Refactor to SwiftIdentifier

Implements first part of https://github.com/mac-cain13/R.swift/issues/136#issuecomment-222360068
Future work:

Add localized resources warnings
Refactor warnings so that it's not an sideeffect anymore

Update this pattern:
let groupedResourceFiles = resourceFiles.groupBySwiftIdentifiers { $0.fullname }
groupedResourceFiles.printWarningsForDuplicatesAndEmpties(source: "resource file", result: "file")

// groupedResourceFiles.uniques.map(stuff)

To the following:
let groupedResourceFiles = resourceFiles.groupBySwiftIdentifiers(
  identifier: { $0.fullname }
  source: "resource file",
  result: "file"
)

// groupedResourceFiles.map(stuff)

Related bug I found while testing https://github.com/mac-cain13/R.swift/pull/235:
If there are duplicate keys in localized string files, a warning is printed, but the key isn't skipped for other localizations. This should be fixed when these two PRs are merged

[ ] Duplicates in one locale should also skip other locales

Example where keys aren't correctly skipped:
// Localized.strings (en)
one = One;
one = One;

// Localized.strings (nl)
one = Een;


Any plans for multi-gpu training support?

Hey Genmo team, thank you so much for the open-source of the fine-tuning code.
Are there any plans for releasing a multi-gpu fine-tuning version?
Was there a specific reason there is only a single-gpu fine-tuning code release? Is it nontrivial to make it multi-gpu training?
Thanks in advance!

Hi @joeljang, at the moment we're not planning to release a multi-GPU trainer. One of the top community requests has been to reduce the minimum resource requirements for using and fine-tuning Mochi, so we made sure the LoRA tuner could run on a single GPU.

@joeljang I don't think it should be terribly difficult to do. You'll need to implement the context parallel backwards passes: https://github.com/genmoai/mochi/blob/main/src/genmo/mochi_preview/dit/joint_model/context_parallel.py + tweak the training loop a bit.


Netopeer-server with TLS

Hi,
We want to use NETCONF with TLS.
For this we have compiled libnetconf with TLS enabled and SSH disabled.

Now when we run netconf-server, it is giving following error:
netopeer2-server -d -v 2
netopeer2-server: symbol lookup error: netopeer2-server: undefined symbol: nc_libssh_thread_verbosity

So we tried to comment out the  nc_libssh_thread_verbosity from main.c and tried to do cmake ..

but now it is giving following error:
CMake Error at CMakeLists.txt:119 (message):
Missing SSH support in libnetconf2, server requires SSH to be supported.
-- Configuring incomplete, errors occurred!

Can you please help us how to compile netopeer for TLS enabled.
Thanks!
Asif

Hi Asif,
SSH support is mandatory for the server (NETCONF requirement), so just compile libnetconf2 with the support for both SSH and TLS and you should be fine. You can disable all SSH interfaces so the server will actually not listen for SSH connections.
Regards,
Michal

Hi,
When I tried compiling libnetconf2 with SSH & TLS on. It got compiled successfully and installed too. But when I am trying to compile Netopeer2, I am getting below errors:
cmake -DCMAKE_BUILD_TYPE=Debug -DCMAKE_INSTALL_PREFIX:PATH=/usr ..
-- Unable to learn libnetconf2 thread support, check skipped
-- Could NOT find CURL (missing:  CURL_LIBRARY CURL_INCLUDE_DIR)
-- libcurl not found, url capability will not be supported
-- Configuring done
-- Generating done
-- Build files have been written to: /home/airvana/masif/netconf/Netopeer2/server/build
Can you please tell me what is the issue?

Hi,
what exact sysrepo version do you have installed? Please pull it again if it is not the latest one.
Regards,
Michal

Hi,
Thanks for the prompt reply. Currently I using all devel version of Netopeer2, sysrepo and libnetconf. With the above option of sr_clean I am able to compile and run it successfully. But netopeer2-server is still listening on SSH instead of TLS. How can I change it to listen on TLS?
Server Log:
[INF]: LN: Listening on <IP_ADDRESS>:830 for SSH connections.
[INF]: LN: Accepted a connection on <IP_ADDRESS>:830.
[INF]: SR: Session 6 (user "root") created.
[2019/11/19 15:11:34.430331, 2] ssh_pki_import_privkey_base64:  Trying to decode privkey passphrase=false
[2019/11/19 15:11:34.432835, 2] ssh_server_connection_callback:  SSH client banner:
[2019/11/19 15:11:34.432858, 1] ssh_analyze_banner:  Protocol mismatch:
[2019/11/19 15:11:34.432871, 1] ssh_server_connection_callback:  No version of SSH protocol usable (banner: )
[2019/11/19 15:11:34.432913, 1] ssh_socket_exception_callback:  Socket exception callback: 2 (2)
[2019/11/19 15:11:34.432935, 1] ssh_socket_exception_callback:  Socket error: No such file or directory
[ERR]: LN: SSH key exchange error (Socket error: No such file or directory).
Client Log:
get_default_CRL_dir: Default CRL dir does not exist, creating it.
nc ERROR: SSL_connect failed (Success).
cmd_connect: Connecting to the <IP_ADDRESS>:830 failed.
Could you please help?

Hi,
mainly, do not connect to the SSH interface. Otherwise, simply change ietf-netconf-server configuration. All of this software is meant to do exactly this, manage configuration, so do it :)
Anyway, the simplest way is just to use
sysrepocfg --edit=vim -m ietf-netconf-server

There you should remove the default SSH listen endpoint and add your TLS listen endpoint. An example of a specific configuration can be found in the repository. As you will see, configuring TLS is not that simple, compared to SSH at least. Reasons are 2. Firstly, you must explicitly configure the authentication, nothing is read from the system. Secondly, there much more authentication artifacts, namely the certificates. To help you understand what each configuration node means, just look into the appropriate models.
Regards,
Michal

Hi,
Certificate leaf has leafref to certificates, which is not present in ietf-keystore yang model present in Netopeer2 devel branch. Can you please tell me if I missing something?
leaf certificate {
type leafref {
path "/ks:keystore/ks:asymmetric-keys/ks:asymmetric-key[ks:"
+ "name = current()/../asymmetric-key]/ks:certificates"
+ "/ks:certificate/ks:name";
}

Hi,
actually, it is there, but taken from a grouping in ietf-crypto-types. These are not modules with simple hierarchy, you should use yanglint, load all the modules and then print the ones you are interested in with print --tree <module-name>. That way you will see all the actual nodes and types in a sensible fashion.
Regards,
Michal

Hi Michal,
Thanks, we were able to run in TLS by setting the desired attributes in ietf-netconf-server yang.
So we basically used sysrepocfg to set the values in ietf-netconf-server.
We have some queries here and need some help here.

Our s/w would be packaged as an image and deployed, so there we cannot run sysrepocfg to configure the netopeer. The TLS or SSH configuration would be fixed for a deployment.
If we dont use sysrepocfg, where are the xml files which are getting modified for the TLS setting, so that we can directly write values there.
We also want to know, like this TLS/SSH configuration, what all default configurations are set in netopeer? Where are the relevant configuration xml files present.

Thanks,
Meghna

Hi,

You cannot directly modify any XML files because there are none. I would strongly recommend using a post-install script for any deployment. But you have many options what to do in this post-install script, easiest is probably to just run sysrepocfg and set the desired configuration.
Now, if you absolutely insist on having a package with everything inside without any scripts, it is theoretically possible. You would have to know the path of sysrepo repository (how would you learn that?) and the startup data for all modules are in there, in libyang LYB binary format. So, you could take your data, print them into LYB (using yanglint, for instance), and then replace <sysrepo-repository>/data/ietf-netconf-server.startup with them.
However, you cannot really install netopeer2 without a post-install script (which installs required modules among other things) so I do not really see the point. Again, you could hack your way around this, too, but I think it is more trouble than it is worth.

Default configuration is set using sysrepocfg just like you did in a script that is executed for make install. This particular script is merge_config.sh.

Also, I want to mention that I have used the modules (ietf-netconf-server and dependencies) from the current IETF drafts (actually, they are no longer current) because there were a significant improvement over the ones used in master (you may have noticed that there is no keystored because it is not needed anymore). However, they are still quite a mess and only the useful and supported parts of them were implemented. They are being worked on but it may still take a significant time until they are finished. Until then the configuration is more complex than it needs to be so, depending on your use-case, it may not be suitable for deployment.
Regards,
Michal

Hi,
Recently while establishing connection between Netopeer2 cli and server using TLS, I used sysrepocfg to merge configuration in ietf-keystore, ietf-truststore, and ietf-netconf-server. After completing merge I saw that I forgot to install oven yang model. After installing all configuration which I merged to ietf-keystore, ietf-truststore, and ietf-netconf-server were lost. Any reason why this happened?
Are we suppose to install all yang models before going for updating configuration files. During run time cant we install any yang models?

Hi,
you would have to provide more details but there is no reason a configuration should just disappear. Also, you are right that you cannot install (or uninstall) YANG modules during run-time and if you do uninstall a module, all its configuration is lost, which I believe makes sense.
So, if you can provide the exact steps (commands) so that I can reproduce the problem, I can explain why it happened or fix any incorrect behavior, otherwise I cannot help.
Regards,
Michal

Hi,
Below are the steps I followed:

Compile and install sysrepo, netopeer2 and libyang all from devel branch.
libnetconf:
cd /home/airvana/masif/netconf/libnetconf2/build
cmake -DENABLE_TLS=ON -DENABLE_SSH=ON ..
make
make install

Sysrepo:
cd /home/airvana/masif/netconf/sysrepo/build
cmake -DCMAKE_BUILD_TYPE=Debug ..
make
make install
make sr_clean
Netopeer2
cd /home/airvana/masif/netconf/Netopeer2/server/build
cmake -DCMAKE_BUILD_TYPE=Debug -DCMAKE_INSTALL_PREFIX:PATH=/usr ..
make
make install

Now I run below commands to merge TLS related changes to configuration files:
sysrepocfg --edit=vim -m ietf-keystore
sysrepocfg --edit=vim -m ietf-truststore
sysrepocfg --edit=vim -m ietf-netconf-server

After all changes are done, I do install/uninstall of any yang model(as of now tried with Oven), and I see all changes which I made in step 2 is gone.

Hi,
you are right, this use-case did not work properly. If you update sysrepo (https://github.com/sysrepo/sysrepo/commit/d7d1c4cc287572a0e925e66320161b0a41550a22), it should no longer get deleted.
Regards,
Michal

Hi,
Thanks for quick fix. It is working fine now.


Fix a short write in sending the RecordingStarted event.

Add the length of the message header to what must be written.

Thanks Bill.


Issue with Indicator Log?

The Jupyter Notebook doesn't like the IndicatorLog.txt file

Check if the indicatorLog is empty. If there is only the header, you can add 0,0 in the next line. It should add the status of the indicators at the beginning of the log automatically to make sure it's never empty. I will look into this issue. As workaround, you can press the triangle button on the PS4 at the start of the recording, or manually add an entry as described above.

Yes, that was the problem. One of the indicatorLogs in one of the runs had only the header. I added 0,0 and it now trains

Great to hear it. I will double-check the Android code and see if I can reproduce and fix this issue.

Some of you ctrl_log files in both train_data and test_data are completely empty. I will revisit the code the make it more robust and produce more meaningful error messages. But I'm not sure how you ended up with empty files. I have collected several hours of data, and not encountered such issues. If you can figure out why you have these empty files, please let me know so I can fix it.

Wow -- I've got no idea! The only change I made to the Android app was the one you suggested to not display the long Chinese Arduino board name.
I presume the ctrlLog.txt is tracking my PS4 controller input? But I notice that there are a lot of other zero-length sensor files in some of those runs, too.
I'm not quite sure how to properly exit the Android app when I'm done, so after I press X to stop logging, I just disconnect the phone from the bot and sometimes after that the app freezes. Do you think that a bad exit from the app could cause those zero-length files?

One other possibility. I changed the Arduino code to use quadrature encoders, and I wonder if the interrupts are disrupting some serial flow at 115k. I also get freezes after a few minutes of driving, like this report:
https://openbot-community.slack.com/archives/C01BRGE07QQ/p1603981059143500
My modified Arduino code is here
Maybe I should be logging at a slower serial rate, like 57k?  It's been a long time since I used classic Atmega 328 Arduinos (as opposed to modern boards, like Teensy or 32u4) so maybe they can't handle 115k serial and interrupts at the same time?

The best way to exist the app is via the back button. Make sure to wait a little bit after collecting the data before you kill the app, to make sure the data is completely written.

I presume the ctrlLog.txt is tracking my PS4 controller input?

Yes.

But I notice that there are a lot of other zero-length sensor files in some of those runs, too.

Yes, if the sensors don't exist on your phone some files will be empty. But only the control and indicator logs are currently used.

Interestingly, on the runs where the ctrlLog size is zero, most of the other sensors are also zero, even though my phone has those sensors and other runs they're not zero. So it definitely looks like a logging issue with the Android app;

Is it possible that the app crashed or was killed in these instances? Because if the log is not closed properly, it may be empty. The file does not get saved after each timestep, but only after the buffer is full or after logging is stopped.

With further testing I was not able to reproduce. Will close it for now. Please reopen if you have any idea what caused the issue in the logs so I can fix it.


Bump rustc_version from 0.2 to 0.4

Is there any chance to push this? Can we get a new release with rustc 0.4?


classification not accurate

[Enter feedback here]
The information protection scanner can inspect any files that Windows can index. If you've configured sensitivity labels to apply automatic classification, the scanner can label discovered files to apply that classification
I think the use of 'classification' in this context is confusing the readers.  AIP is about protection and labels - so we can apply "risk" like confidental.  When we talk about classification - its typically centered around business context (e.g. tax forms, statement of work, etc.) - this makes it seem like AIP scanner can apply both types of classification, and I dont think that is the case..

Document Details
⚠ Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

ID: 893cad7d-7625-9ad1-0454-0180c2084aa5
Version Independent ID: 893cad7d-7625-9ad1-0454-0180c2084aa5
Content: Learn about the Microsoft Purview Information Protection scanner - Microsoft Purview (compliance)
Content Source: microsoft-365/compliance/deploy-scanner.md
Service: o365-seccomp
GitHub Login: @libarson
Microsoft Alias: libarson

@libarson Please help us in resolving this issue. Thanks

@gnerd Thanks for your feedback! New issues and pull requests for this content are closed while we update this content to support upcoming feature improvements.


pdftotree.parse() returns None

Describe the bug
A call to html = pdftotree.parse() returns None for some documents.
To Reproduce
Steps to reproduce the behavior:

Download the file
CaseStudy_ACS.pdf

Execute the code
html = pdftotree.parse(pdf_file="CaseStudy_ACS.pdf", html_path=None, model_type=None, model_path=None, favor_figures=True, visualize=False)

Expected behavior
The variable html should contain the html markup for the text in the PDF.
Error Logs/Screenshots
However the variable html is set to None.
Environment (please complete the following information):

OS: Ubuntu 18.04
Python: 3.6.4 (Anaconda distribution)
pdftotree Version: v0.4.0

https://github.com/HazyResearch/pdftotree/issues/45
?

Thanks for the pointer @BoPengGit . I checked the example I have shared above. It is not a scanned document. I am able to select the text. Also, on zooming, the fonts do not get blurred.

Hello,
I have the same issue. The issue in my case is that the parser returns None if the pdf (not scanned) file has a digital signature.


Issue with k8s.io/docs/tasks/configure-pod-container/configure-pod-configmap/

This is a...

[x] Feature Request
[ ] Bug Report

Problem:
Unlike other tasks in documentation this site presents pod definitions but doesn't contain file urls for creation which makes following a bit frustrating/time consuming.
Proposed Solution:
Replace pod creation YAMLs with files available through public URL so that kubectl create -f <URL> --edit could be used.
Page to Update:
https://k8s.io/docs/tasks/configure-pod-container/configure-pod-configmap/

豆腐干夹具

/assign @DanyC97

@moby04 thanks for raising it, i've already tagged it in https://github.com/kubernetes/website/issues/12740 , will work on it soon


C++/C-API generation

Also, Perhaps do all validation in C++ and wrap in a C-API to call from Python?

Closing and replacing with specific issues relating to the CPP generation added by PR #37 .


Major Jest Upgrades

Jira
http://vjira2:8080/browse/BDS-1041
Summary
Major upgrades to Jest to support testing web component rendering in a browser and web page instance that's generated automatically, in addition to adding the ability to run visual regression tests on these.
Details
Jest-specific Updates

Updates global Jest config to automatically skip over *.e2e.js and *.data.js test files
Added automatic transpiling of ES6 code (via Babel) to allow component tests to use modern JS libraries
Polyfilled / updated the testing environment in order to use helper libraries for testing web components
Wired up Jest to automatically boot up webpack dev server to remove the need to compile Pattern Lab before running any Jest tests

Added new webpack dev server setup for quickly testing components using JIT (just in time) compiling

Added visual regression testing to Jest + add jest-dom as a new tool to help evaluate the state of the DOM inside components being tested

Also added simple image screenshot test reporting functionality to Jest to assist with debugging VRT issues until full Github integration is wired up

Faster Twig Renderer:

Update Twig renderer to include external method to stop currently running server
Updated Twig renderer calls in button component example to compile even faster

Jest Test-specific Updates

Renamed the figure component test's external data file to automatically get excluded
Removed the old button component JS test
Wired up the existing button component's Jest tests to now include two visual regression tests in addition to to web component test examples
Moved the image component's test file to the proper folder
Updated the monorepo Jest test to speed things up by 20 seconds!

How to test

Review updates to understand the changes this includes -- especially the main jest config file + the button component's test updates!
Confirm Jest tests running as expected
Confirm the full build runs and deploys as expected

Approved 👍 Love that we can now use ES6 in our test files and that we can exclude supporting files like *.data.js. Good stuff! Ran locally and start/test/build all worked as expected.
One question... I ran npm run test after doing a full clean and setup and the button Jest test took ~30 seconds. Ran it again, took ~15 seconds. Ran it again, took ~8 seconds. How/why does this get faster each time? Is this expected?

Thanks @danielamorse!
The faster subsequent test runs are probably related to a few different things (all related to caching):

The Webpack Dev Server instance we spin up (serving from in-memory)
The Webpack Hard Source Plugin (hard cache of certain Webpack assets)
The @bolt/twig-renderer trying to stay alive to speed up subsequent Twig requests
Jest’s own cache to help speed up and/or skip tests without any changes (don’t quote me on this one ☝)

Also, fwiw, I think there’s still a couple additional optimizations we might be able to try out to speed things up even further — running a test within 30s is just the ballpark max time I’m shooting for with this initial round of updates!

Thanks guys!!


Bayer data handling has the LSBits reversed

In https://github.com/waveform80/picamera/blob/master/docs/examples/bayer_data.py#L55 when describing the 2 least sig bits from the 4 pixels, the order is reversed.
The correct order is:
#  byte 1   byte 2   byte 3   byte 4   byte 5
# AAAAAAAA BBBBBBBB CCCCCCCC DDDDDDDD DDCCBBAA

as confirmed by https://linuxtv.org/downloads/v4l-dvb-apis-new/uapi/v4l/pixfmt-srggb10p.html or the CSI-2 spec.

Doh - well spotted! I'll get that fixed in 1.14


fix: articles/jenkins/tutorial-jenkins-dev-spaces.md

Space in code span

@nschonni : Thanks for your contribution! The author(s) have been notified to review your proposed change.


Add GPT-4o

Describe the feature
Add the recently released GPT-4o to the list of models https://openai.com/index/hello-gpt-4o/

I was hoping for the same, but I think this repo has been abandoned and we just have to move to something different.

Does someone know any extension equivalent to Genie?

I was hoping for the same, but I think this repo has been abandoned and we just have to move to something different.

That would be seed. I truly appreciate this extension and discovered it to be a better fit for me than Copilot.

I was hoping for the same, but I think this repo has been abandoned and we just have to move to something different.

Not to mention, it was never open source in the first place... Would love to see a community driven version of this.

Go to C:\Users[your username].vscode\extensions\genieai.chatgpt-vscode-0.0.10\ and edit package.json by replacing in genieai.openai.model "gpt-4" by "gpt-4o"
Then goto the \out folder and edit extension.js:
Update this line, replacing gpt-4 option by gpt-4o:
var Q1={"gpt-4-1106-preview":{maxTokens:8192,version:"gpt-4",type:"chat"},"gpt-4o":{maxTokens:8192,version:"gpt-4",type:"chat"},"gpt-4-32k":{maxTokens:32768,version:"gpt-4",type:"chat"},"gpt-4-0613":{maxTokens:8192,version:"gpt-4",type:"chat"},"gpt-4-32k-0613":{maxTokens:32768,version:"gpt-4",type:"chat"},"gpt-3.5-turbo-1106":{maxTokens:4096,version:"gpt-3.5",type:"chat"},"gpt-3.5-turbo":{maxTokens:4096,version:"gpt-3.5",type:"chat"},"gpt-3.5-turbo-16k":{maxTokens:4096,version:"gpt-3.5",type:"chat"},"gpt-3.5-turbo-instruct":{maxTokens:4096,version:"gpt-3.5",type:"chat"},"text-davinci-003":{maxTokens:4096,version:"gpt-3.5",type:"text"},"text-davinci-002":{maxTokens:4096,version:"gpt-3.5",type:"text"},"text-curie-001":{maxTokens:2048,version:"gpt-3",type:"text"},"text-babbage-001":{maxTokens:2048,version:"gpt-3",type:"text"},"text-ada-001":{maxTokens:2048,version:"gpt-3",type:"text"},"code-davinci-002":{maxTokens:8001,version:"gpt-3.5",type:"codex"},"code-cushman-002":{maxTokens:2048,version:"gpt-3",type:"codex"}},lo="gpt-4-1106-preview";
Then deactivate and reactivate the extension, go to settings and update the model. And enjoy!

"gpt-4o":{maxTokens:8192,version:"gpt-4",type:"chat"},

shouldn't it be version: "gpt-4o" as well?

"gpt-4o":{maxTokens:8192,version:"gpt-4",type:"chat"},

shouldn't it be version: "gpt-4o" as well?

No

Go to C:\Users[your username].vscode\extensions\genieai.chatgpt-vscode-0.0.10\ and edit package.json by replacing in genieai.openai.model "gpt-4" by "gpt-4o"
Then goto the \out folder and edit extension.js: Update this line, replacing gpt-4 option by gpt-4o: var Q1={"gpt-4-1106-preview":{maxTokens:8192,version:"gpt-4",type:"chat"},"gpt-4o":{maxTokens:8192,version:"gpt-4",type:"chat"},"gpt-4-32k":{maxTokens:32768,version:"gpt-4",type:"chat"},"gpt-4-0613":{maxTokens:8192,version:"gpt-4",type:"chat"},"gpt-4-32k-0613":{maxTokens:32768,version:"gpt-4",type:"chat"},"gpt-3.5-turbo-1106":{maxTokens:4096,version:"gpt-3.5",type:"chat"},"gpt-3.5-turbo":{maxTokens:4096,version:"gpt-3.5",type:"chat"},"gpt-3.5-turbo-16k":{maxTokens:4096,version:"gpt-3.5",type:"chat"},"gpt-3.5-turbo-instruct":{maxTokens:4096,version:"gpt-3.5",type:"chat"},"text-davinci-003":{maxTokens:4096,version:"gpt-3.5",type:"text"},"text-davinci-002":{maxTokens:4096,version:"gpt-3.5",type:"text"},"text-curie-001":{maxTokens:2048,version:"gpt-3",type:"text"},"text-babbage-001":{maxTokens:2048,version:"gpt-3",type:"text"},"text-ada-001":{maxTokens:2048,version:"gpt-3",type:"text"},"code-davinci-002":{maxTokens:8001,version:"gpt-3.5",type:"codex"},"code-cushman-002":{maxTokens:2048,version:"gpt-3",type:"codex"}},lo="gpt-4-1106-preview";
Then deactivate and reactivate the extension, go to settings and update the model. And enjoy!

I use a different approach for this:
instead of change the gpt-4 to gpt-4o, I added this "gpt-4o":{maxTokens:8192,version:"gpt-4",type:"chat"},"gpt-4o-2024-05-13":{maxTokens:8192,version:"gpt-4",type:"chat"}, before "gpt-4-1106-preview" then on package.json on "genieai.openai.model" I also added two new models: "gpt-4o" and "gpt-4o-2024-05-13" related to what I added on extension.js

Congrat, it's cleaner than what I did :-)

Hi everyone - The new models are now available in v0.0.11 please update your extensions. gpt-4o is set as default. The editor view issue is also fixed and now it uses your selected model instead of the deprecated legacy OpenAI model.

Oh wow, thanks for coming back to the extension @genieai-info ! I've loved to use the extension, good to see I don't have to switch over to anything else.


how to set up a page like fixmyphoto

Hi,  i want to train my own dataset, and after that I  try to set up a page to interactively put mask on image and get result. can you share your code of fixmyphoto page  or would you please tell me how to do it?   thanks.

I am looking for the same. The code to fixmyphoto would be really helpful. Also is GPU required to run fixmyphoto?


Custom Column Type

Is your feature request related to a problem? Please describe.
Currently, go-jet generator supports only a limited type of columns. For example, for uuid, text or bytea columns only the postgres.ColumnString type is used.
The issues I'm facing at the moment is I cannot derive the real type of the column, and therefore it's impossible to dynamically build WHERE clause.
Example SQL table:
CREATE TABLE table1 (
    id              UUID PRIMARY KEY,
    value           TEXT
);

Now, I have a function that creates postgres.BoolExpression based on the column type:
func (b JetFilterBuilder) buildEqExpression(col postgres.Column, value string) (postgres.BoolExpression, error) {
	switch typedCol := col.(type) {
	case postgres.ColumnString:
		return typedCol.EQ(postgres.String(value)), nil
        // Skip rest of the code.
}

If I use table.Table1.Id column and pass some text value, it will create SQL like this one:
WHERE id = 'value'::text

Describe the solution you'd like
Options
Option 1
Enable the user to use custom column type during the generation. Right now, I think it's not possible using the generator.
Example of my attempt:
return tableBuilder.UseColumn(func(column metadata.Column) template.TableSQLBuilderColumn {
	if column.DataType.Name == "uuid" {
		return template.TableSQLBuilderColumn{
			Name: column.Name,
			Type: "UUID",
		}
	}

	return template.DefaultTableSQLBuilderColumn(column)
})

Will generate:
type table1 struct {
	postgres.Table

	//Columns
	id               postgres.ColumnUUID // <---------- type doesn't exists.
|

Would be nice to have the same ability to pass a type, as it's done for model field type.
Option 2
Add real column type and other metadata to the Column instance. However, it might increase the size of the column object.
My current solution
I run a tool that will parse the AST tree of the generated file and change the column type to the custom one.
Custom column type example:
type ColumnUUID struct {
	postgres.ColumnString
}

func UUIDColumn(val string) ColumnUUID {
	return ColumnUUID{postgres.StringColumn(val)}
}

Final goal
Assume I had the ability to introduce my custom column, my code would look like:
func (b JetFilterBuilder) buildEqExpression(col postgres.Column, value string) (postgres.BoolExpression, error) {
	switch typedCol := col.(type) {
	case postgres.ColumnString:
		return typedCol.EQ(postgres.String(value)), nil
	case custom_package.ColumnUUID:
                uuidVal := parseUUID(value)
		return typedCol.EQ(postgres.UUID(uuidVal)), nil
        // Skip rest of the code.
}

Thoughts
Maybe I missed something, and it's still possible to achieve my goal without any changes to the current version of go-jet, yet I haven't found one.
When I faced the issue, it seemed to me that there is no value in not exposing jet internal interfaces and structs, that could make other developer's life much easier, by extending the library with custom types and other features.

Hi @amanbolat,
As I see it, the issue is that postgres.String adds a mandatory ::text cast. And that's unfortunate because behind postgres.String, there can be any of the currently unsupported types (like json, uuid, etc...). The simplest solution would be to have a string literal function without sql cast. Luckily, there is one already postgres.UUID, so a workaround in your case would be:
func (b JetFilterBuilder) buildEqExpression(col postgres.Column, value string) (postgres.BoolExpression, error) {
	switch typedCol := col.(type) {
	case postgres.ColumnString:
		return typedCol.EQ(postgres.UUID(value)), nil   //<-- Use UUID constructor for both text and uuid columns
        // Skip rest of the code.
}

I like both of your ideas, but I think once we add support for missing types, there would be much need for such a feature.

Hi @go-jet,
Thank you for the suggestion, yet I need an explicit check in case of UUID as in my example:
case custom_package.ColumnUUID:
    uuidVal := parseUUID(value)
    return typedCol.EQ(postgres.UUID(uuidVal)), nil

The same will be required for JSON and JSONB types for my use case.
My current solution of extending the generator with AST parsing and substitution works as expected, but it feels as a hack.
Nevertheless, I suppose it's hard to keep the library up to date with all the possible types and different databases. Therefore, exposing internal types and interfaces seems a better solution in a long term.
I would like to make some contribution and open the PRs, however I'm still trying to understand all the internal architecture to make sure that my requirements do align with your vision.

Are there any plans to support custom types?

This issue is more about adding additional type information to the SQL builder column types.
You can customize the generator to use your custom model type, and use raw expressions if needed for sql builder part.

This issue is more about adding additional type information to the SQL builder column types.
You can customize the generator to use your custom model type, and use raw expressions if needed for sql builder part.

Yes, sorry, I meant additional type information for the SQL Builder because I'm having a similar issue. In my case my primary keys and some indexed columns in Postgres are varchar(41) and as they are strings jet is type casting them with ::text which prevents postgres from using the indexes. I workaround this by using postgres.UUID as you mentioned but you need to remember to use that instead of String every time, I was looking for a way to enforce that

Would defining a new VARCHAR41 constructor work for you?
func VARCHAR41(str string) StringExpression {
	return StringExp(CAST(String(str)).AS("varchar(41)"))
}

String type is to general. I believe a solution for all the issues in these thread is to implement separate expression types for TEXT, VARCHAR, UUID, etc ... This way we will ensure type safety and enough information to build dynamic queries based on column type.

String type is to general. I believe a solution for all the issues in these thread is to implement separate expression types for TEXT, VARCHAR, UUID, etc ... This way we will ensure type safety and enough information to build dynamic queries based on column type.

Agreed!! That would be really nice

For now, in release v2.12.0, added new constructors for Postgres-specific character types, including Text, Char, and VarChar.


shap.TreeExplainer() is not working when we use Xgboost.fit function.

We can get the predicted output when we use xgboost.fit and train model. But It doesn't work when I try to run this code
shap_values_xgb = shap.TreeExplainer(xgb_clf).shap_values(test.as_matrix())

`param_distribs = {
"n_estimators": stats.randint(3, 40),
"max_depth": stats.randint(3, 40),
"learning_rate": stats.uniform(0.05, 0.4),
"gamma": stats.uniform(0, 10),
}
rnd_search = RandomizedSearchCV(xgb.XGBClassifier(random_state=42),
param_distributions=param_distribs, return_train_score=True,
n_iter=100, cv=5, scoring='roc_auc', random_state=42, n_jobs=-1)
this will take a long time
rnd_search.fit(data_train_X, data_train['died_hosp'])`
cv_rlt = rnd_search.cv_results_ pd.DataFrame(sorted(list(zip(cv_rlt["mean_test_score"], cv_rlt['mean_train_score'], cv_rlt["params"])),                      key=lambda x: x[0], reverse=True), columns=['X-val scores', 'Train scores', 'Params'])
xgb_clf = rnd_search.best_estimator_ xgb_clf.fit(data_train_X.as_matrix(), data_train['died_hosp'].as_matrix()) with open('../models/xgb_clf_final_round.pkl', 'wb') as f:     pickle.dump(xgb_clf, f)
with open('../models/xgb_clf_final_round.pkl', 'rb') as xgb:     xgb_clf = pickle.load(xgb)
class Xgb_clf(BaseEstimator, ClassifierMixin):
    def fit(self, X, y=None):
        return xgb_clf
    def predict_proba(self, X):
        return xgb_clf.predict_proba(X)

xgb_pipeline.fit(train.as_matrix())
sample_xgb_correct_survived,index_xgb_correct_survived = get_test_sample(xgb_pipeline, correct=True, survived=True, seed=48, count=10)
result_xgb_correct_survived = xgb_pipeline.predict_proba(sample_xgb_correct_survived)
result_xgb_correct_survived

Up to here it is working. I got the output of "result_xgb_correct_survived"
shap_values_xgb = shap.TreeExplainer(xgb_clf).shap_values(test.as_matrix())
in here I got an error. ValueError: feature_names mismatch

Usually feature_names mismatch is because you trained on a dataframe with columns names but try and explain a numpy array without those names. XGBoost complains because the feature names don't match. Does shap.TreeExplainer(xgb_clf).shap_values(test) work?

shap.TreeExplainer(xgb_clf).shap_values(test)
No this didn't work. it gives that error. Feature names mismatch. But I get the predicted results for new instances. Only this line is not working.

Model is working properly. I can get the results. Only SHAP explainer is not working. :/

Hmm, well for XGBoost the core algorithm is merged into the XGBoost binary. So in the package we call xgb_clf.get_booster().predict(test, pred_contribs=True). Does that give the same error?
I would suggest making sure you have something that works for the xgb_clf.get_booster().predict method. If that works and the TreeExplainer doesn't then I can see if there is a bug.

I am using here
xgb_clf = rnd_search.best_estimator_
xgb_clf.fit(data_train_X.as_matrix(), data_train['died_hosp'].as_matrix())
with open('../models/xgb_clf_final_round.pkl', 'wb') as f:
    pickle.dump(xgb_clf, f)

xgb_clf.fit method. Model is working for that as well finely. But to get xgb_clf.get_booster() I need to use xgboost.train(). But still I am trying to change it for that. But I couldn't. My question is your SHAP package is compatible only for the output of xgboost.train(). What about the output of xgb_clf.fit() ?

xgb_clf.fit() is a method of XGBClassifier that follows the sklearn api. shap does support XGBClassifier, but to better debug your error I suggest you use XGBClassifier's get_booster() method to get the raw XGBoost booster object (the same one you get with xgboost.train()) and make sure you can make predictions with that.

I fixed this one. Thanks

Great!
On Sat, Jun 23, 2018 at 3:14 PM Dili<EMAIL_ADDRESS>wrote:

I fixed this one. Thanks
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
https://github.com/slundberg/shap/issues/125#issuecomment-399714087, or mute
the thread
https://github.com/notifications/unsubscribe-auth/ADkTxXGt0Gll3JwEReYYtFpbT2bee83Mks5t_r3hgaJpZM4UxR5Z
.

@DiliSR  - can you tell me how you got Shap values for sklearn api(xgbclassifier) ?


RN 0.66 Could not find com.mapbox.mapboxsdk:mapbox-android-accounts:0.7.0

Describe the bug
After upgrading React Native from 0.63.4 to 0.66 android project does not compile, showing the error:
Execution failed for task ':app:checkDebugAarMetadata'.
> Could not resolve all files for configuration ':app:debugRuntimeClasspath'.
   > Could not find com.mapbox.mapboxsdk:mapbox-android-accounts:0.7.0.
     Required by:
         project :app > project :react-native-mapbox-gl_maps > com.mapbox.mapboxsdk:mapbox-android-sdk:9.1.0

Versions (please complete the following information):

Platform: Android
Dev OS: macOS 11.6
react-native-mapbox-gl Version 8.3.0
React Native Version 0.66

notice, that this is probably just a temporary workaround as jcenter as a dep repo is no longer maintained indefinitely (some time 2022 I believe).
I couldn't get it to work with mavenCentral unfortunately, although I believe, that mapbox did move their deps there 😕

can you please try with:
android/build.gradle
repositories {
    // ...
    jcenter()
}

works for me, really thank you

jcenter() is no longer supported in new RN versions

jcenter.bintray.com is consistently returning error codes today. Because of that, we are removing jcenter from build.gradle to unblock Android builds locally. Doing so results in the error mentioned in this Issue's original description.
> Could not resolve all files for configuration ':app:dataminrStagingDebugRuntimeClasspath'.
   > Could not find com.mapbox.mapboxsdk:mapbox-android-accounts:0.7.0.
     Searched in the following locations:
       - https://repo.maven.apache.org/maven2/com/mapbox/mapboxsdk/mapbox-android-accounts/0.7.0/mapbox-android-accounts-0.7.0.pom
       - https://dl.google.com/dl/android/maven2/com/mapbox/mapboxsdk/mapbox-android-accounts/0.7.0/mapbox-android-accounts-0.7.0.pom
       - https://www.jitpack.io/com/mapbox/mapboxsdk/mapbox-android-accounts/0.7.0/mapbox-android-accounts-0.7.0.pom
     Required by:
         project :app > project :react-native-mapbox-gl_maps > com.mapbox.mapboxsdk:mapbox-android-sdk:9.1.0

Despite the fact that Jfrog says it will maintain it as read-only indefinitely, my team has seen issues where Jcenter + Bintray are unavailable which blocks any new Android builds.
It would be beneficial to move these dependencies to an actively-maintained dependency repository, like mavenCentral, to avoid the potential pain caused by jcenter's reliability diminishes over time.

I also saw this Pull Request that references the flakiness of jcenter in January of this year.

We spent the majority of the morning trying to fix this issue.  Seems the conclusion was that jcenter was down and now it is back up.  We are using React-Native 0.64.1, because some dependencies have not yet updated, and jcenter was still kept on as read only.

jcenter.bintray.com is consistently returning error codes today. Because of that, we are removing jcenter from build.gradle to unblock Android builds locally. Doing so results in the error mentioned in this Issue's original description.
> Could not resolve all files for configuration ':app:dataminrStagingDebugRuntimeClasspath'.
   > Could not find com.mapbox.mapboxsdk:mapbox-android-accounts:0.7.0.
     Searched in the following locations:
       - https://repo.maven.apache.org/maven2/com/mapbox/mapboxsdk/mapbox-android-accounts/0.7.0/mapbox-android-accounts-0.7.0.pom
       - https://dl.google.com/dl/android/maven2/com/mapbox/mapboxsdk/mapbox-android-accounts/0.7.0/mapbox-android-accounts-0.7.0.pom
       - https://www.jitpack.io/com/mapbox/mapboxsdk/mapbox-android-accounts/0.7.0/mapbox-android-accounts-0.7.0.pom
     Required by:
         project :app > project :react-native-mapbox-gl_maps > com.mapbox.mapboxsdk:mapbox-android-sdk:9.1.0

Despite the fact that Jfrog says it will maintain it as read-only indefinitely, my team has seen issues where Jcenter + Bintray are unavailable which blocks any new Android builds.
It would be beneficial to move these dependencies to an actively-maintained dependency repository, like mavenCentral, to avoid the potential pain caused by jcenter's reliability diminishing over time.

Hi we're experiencing the same issue, are you able to resolve the issue by now?

Still not building...Any news or workaround?
Thanks!

I confirm, it's the only way to build right now getting rid of jcenter dependencies. Thanks mate!
PS. Be aware to follow the process of issuing a download token, and everything should be fine!

I've followed these instructions to the letter but still no joy

@Dakuan Did you find anyway to fix it ?


Store -G/--group value into environment variable GROUP

Added a callback argparse.Action to get_parser so that any inheriting module will automatically store the value of args.group into the environment variable GROUP.
For the shell scripts (jobsub_cmd, jobsub_q), pull the group flag/value out of the args, store it in GROUP, and modify args so that condor doesn't complain about the -G/--group flag getting passed.

I tested this with jobsub_submit and jobsub_q on both jobsubdevgpvm01 and DUNE pool.  I think I got the sed expression right, but please double check that for me!

Oops - forgot to say that this addresses #1

Looks good, Thanks!


logstash 6.0.1 plugin install error

Using ubuntu 16.04.3 trying to install logstash-filter-oui, keeps returning the error......
Validating logstash-filter-oui
Installing logstash-filter-oui
Plugin version conflict, aborting
ERROR: Installation Aborted, message: Bundler could not find compatible versions for gem "sequel":
In snapshot (Gemfile.lock):
sequel (= 5.2.0)
In Gemfile:
logstash-input-jdbc (>= 0) java depends on
sequel (>= 0) java
logstash-input-jdbc (>= 0) java depends on
  sequel (>= 0) java

logstash-filter-oui (>= 0) java depends on
  oui-offline (>= 1.2.6) java depends on
    sequel (~> 4) java

Running bundle update will rebuild your snapshot from scratch, using only
the gems in your Gemfile, which may resolve the conflict.

Bundler could not find compatible versions for gem "logstash-core":
In snapshot (Gemfile.lock):
logstash-core (= 6.0.1)
In Gemfile:
logstash-core-plugin-api (>= 0) java depends on
logstash-core (= 6.0.1) java
logstash-input-syslog (>= 0) java depends on
  logstash-filter-grok (>= 0) java depends on
    logstash-core (>= 5.6.0) java

logstash-filter-oui (>= 0) java depends on
  logstash-core (< 2.0.0, >= 1.4.0) java

logstash-core (>= 0) java

Running bundle update will rebuild your snapshot from scratch, using only
the gems in your Gemfile, which may resolve the conflict.
Bundler could not find compatible versions for gem "logstash":
In Gemfile:
logstash-filter-oui (>= 0) java depends on
logstash (< 2.0.0, >= 1.4.0) java
Could not find gem 'logstash (< 2.0.0, >= 1.4.0) java', which is required by gem 'logstash-filter-oui (>= 0) java', in any of the sources.

Seeing the same issue as well on CentOS with Logstash 6.0.1

A more compatible gem will be released today.

@steakknife Did you end up cutting an updated Gem?
https://rubygems.org/gems/oui-offline/versions doesn't show a newer version since 2016 - however, I'm not too familiar with Ruby/gems, so not sure if this is definitive.

Any progress on this plugin? It still fails with the same errors with Logstash 6.4.1.

The problem remains in 6.4.3.
I could be wrong but it seems like this would be resolved if the ruby gem oui-offline version 1.2.8 was uploaded to https://rubygems.org/gems/oui-offline/ . Then this could use sequel 5. Mine is trying to use sequel 5.14 and failing because of the ~> 4.
Seems to exist:
https://github.com/steakknife/oui/tree/1.2.8
Pull request for oui-offline gem where this was resolved:
https://github.com/steakknife/oui/pull/21
How can we help with this?


Remove files from values-en folder

We were required to put the string values in both values and values-enthe files. This has been handled now by gradle to ignore the translation. Hence deleting the values-en folder
cc - @rohan-dhamal-clarice @aleffert

Otherwise seems good

Merging this


[#1 Sofware Updates] Adding Plan struct

Reviewer: @mlunoe

LGTM, only problem is ServicePlanPhases is introduced in #125 but I think we can merge them in succession honestly.

let's just close this one and review #125 as one PR imo


Directory Structure

Create directory structures for src and test.

index.js link was not updated package.json as part of this change which made this npm module pretty useless.

Fixed in v1.1.2


Highlights all tags of the same type rather than just closing/opening tag

When placing the cursor in a tag, all tags of the same type are highlighted rather than just the closing/opening tag.

This is what I would expect to happen:

@alexchantastic I see your issue but I believe the problem of highlighting may be accentuated by the VSCode theme you are using. I am personally using One Dark Italic where the all of the other tags are still highlighted but more subtly. I may be able to create a version of your theme where the tag highlighting is hidden if you would like.

Hey @alexchantastic, I have just pushed an update to Twig Language 2 with a brand new formatter using Prettydiff 3 which brings about some major bug fixes. I tested your issue with a fresh install of VS Code and it seems to be the system default behaviour of highlighting all instances of selected text, a behaviour that also occurs when using Twig Pack extension. Sorry about the slow development speeds and sub-par communication but hopefully these updates have fixed some of your other problems.


nuxt build generates a hidden file under .nuxt/dist/client/commons/

Versions

nuxt: 2.13.3
node: 13.14.0
@nuxt/typescript-build: 1.0.3
@nuxt/typescript-runtime: 0.4.10

The problem
A hidden chunk-file is generated when running nuxt-ts build. This is the full path of the file generated for me:

/.nuxt/dist/client/commons/.a9cf80a.js

The problem is that this hidden file is later inaccessible by the http server and thus this chunk returns 404 in a built application.
After some digging, I found in the docs that chunk names are preceded by an id as follows:

[id].[contenthash].js

My first thought was that probably this id was coming out as zero (0) and being omitted in a number conversion or something like that (still don't know if that is the case though). But I managed to solve the problem with a workaround and the result also indicates the same cause.
Reproduction
I've done many builds, but this is the first time it happened. So I don't know exactly the cause. But the result was this file:

All other chunks are normally accessed and this is the only one that came out that way, as a hidden file. So when trying to access it via http:

Just for testing purposes, I renamed it without the dot, and it was then accessible:

So when building the app and deploying to my servers, only this chunk was inaccessible and breaking some behavior of the application.
My Solution
Digging in the docs, I found out that I could change built filename patterns. I did that by prefixing a letter c to the chunkId:

The result was the following files. None came as a hidden file and one came with a id=0:

That solved my problem. No hidden files were generated and the application was able to access all built chunks. The zero id may itself also indicate this could be the cause of the problem.

Same thing happens to me with;

nuxt: 2.13.3
node: 12.18.1
@nuxt/typescript-build: 1.0.3
@nuxt/typescript-runtime: 0.4.10

And @cainaf's solution also saved me;

Digging in the docs, I found out that I could change built filename patterns. I did that by prefixing a letter c

Thank you.

Same problem here.
I have page components that use asyncData, and have some normal components that use the new fetch hook functionality from 2.12.
This problem only affects the pages that have components with the new fetch hook for me.
thank you @cainaf , the chunk workaround works nicely!

Should be fixed by https://github.com/nuxt/nuxt.js/pull/7667

I have same problem on version 2.13.3 (2.13.2 works fine). Changing filename pattern resolves that problem, but there is another one: that file includes a lot of shared components that shouldn't be loaded together.
Try to explain:
I use different components for mobile and desktop (I import them as async components using @nuxtjs/device to detect version), but these components could have same logic, that is extracted to a common file.
For example, we have HomePage and AboutPage.
Home page imports asynchronously ComponentAMobile or ComponentADesktop, each of them import synchronously ComponentACommonLogic.js
About page imports asynchronously ComponentBMobile or ComponentBDesktop, each of them import synchronously ComponentBCommonLogic.js
And in this case ComponentACommonLogic and ComponentBCommonLogic will be placed in that hidden file. But home page doesn't need ComponentBCommonLogic.


PRs and Issues can not load for any Github repo

Extension version: v0.70.0
VSCode Version: 1.81.1
OS: MacOs

Steps to Reproduce:

Install the Github PR extension
Open with any Github repo

The log is:

here is my settings:
"githubPullRequests.logLevel": "debug",
    "githubPullRequests.queries": [
        {
            "label": "Waiting For My Review",
            "query": "is:open review-requested:${user}"
        },
        {
            "label": "Assigned To Me",
            "query": "is:open assignee:${user}"
        },
        {
            "label": "Created By Me",
            "query": "is:open author:${user}"
        }
    ]

More logs:

Do you have the built in git extension enabled?


custom-server-typescript example is not working with Next 6

[x] I have searched the issues of this repository and believe that this is not a duplicate.
Expected Behavior
yarn install then yarn dev should result in a running program.
Current Behavior
Get this error
(node:79838) UnhandledPromiseRejectionWarning: Error: Cannot find module './dist/server/build/babel/preset'
    at Function.Module._resolveFilename (module.js:543:15)
    at Function.Module._load (module.js:470:25)
    at Module.require (module.js:593:17)
    at require (internal/module.js:11:18)
    at Object.<anonymous> (/Users/trent/home/projects/Grok/tmp/next.js/babel.js:1:18)
    at Module._compile (module.js:649:30)
    at Module.m._compile (/Users/trent/home/projects/Grok/tmp/next.js/examples/custom-server-typescript/node_modules/ts-node/src/index.ts:422:23)
    at Module._extensions..js (module.js:660:10)
    at Object.require.extensions.(anonymous function) [as .js] (/Users/trent/home/projects/Grok/tmp/next.js/examples/custom-server-typescript/node_modules/ts-node/src/index.ts:425:12)
    at Module.load (module.js:561:32)
    at tryModuleLoad (module.js:501:12)
    at Function.Module._load (module.js:493:3)
    at Module.require (module.js:593:17)
    at require (internal/module.js:11:18)
    at requireModule (/Users/trent/home/projects/Grok/tmp/next.js/examples/custom-server-typescript/node_modules/@babel/core/lib/config/files/plugins.js:142:12)
    at loadPreset (/Users/trent/home/projects/Grok/tmp/next.js/examples/custom-server-typescript/node_modules/@babel/core/lib/config/files/plugins.js:56:15)
(node:79838) UnhandledPromiseRejectionWarning: Unhandled promise rejection. This error originated either by throwing inside of an async function without a catch block, or by rejecting a promise which was not handled with .catch(). (rejection id: 3)
(node:79838) [DEP0018] DeprecationWarning: Unhandled promise rejections are deprecated. In the future, promise rejections that are not handled will terminate the Node.js process with a non-zero exit code.
[nodemon] clean exit - waiting for changes before restart

Your Environment

Tech
Version

next
6.0.0

node
9.8.0

OS
macOS 10.13.4

Actually it works if you follow instructions to clone only this example to separate path.
You can't clone all the repo and try to run only this example, it look like next read babel configuration in parent dir.
Otherwise, you can add a .babelrc files containing
{
    "presets": [
        "next/babel"
    ]
}

Works fine for me yarn create next-app --example custom-server-typescript custom-server-typescript-app.
@tashburn when creating issues please provide a clear and concise steps to reproduce.
Like @franxois said if you clone the repository you have to build the code, but there's multiple ways to install examples that are faster than cloning the whole codebase + examples 👍


Entity Work Jan 4 - Manny

Required items, please complete
Change(s):

Working on some of the detections Shain asked us to focus on, mainly adding fullName identifiers

Reason for Change(s):

Changes needed listed on Shain's dashboard

Version Updated:

yes

Testing Completed:

yes

Checked that the validations are passing and have addressed any issues that are present:

no

Hello @mmelndezlujn, Shain has requested some changes please take a look at it

Hello @mmelndezlujn, Shain has some requested changes. Kindly please have a look at it.
Thanks

Hello @mmelndezlujn,
Can you provide write access to your branch. I'll try to resolve validation errors.

Hello @mmelndezlujn, Can you provide write access to your branch. I'll try to resolve validation errors.

Hello @v-prasadboke, I am not sure if I can provide write access as I am not the repo owner.
@shainw could you help me with this, please? :)

Hello @mmelndezlujn, Can you provide write access to your branch. I'll try to resolve validation errors.

Hello @v-prasadboke, I am not sure if I can provide write access as I am not the repo owner.
@shainw could you help me with this, please? :)

Hi @shainw, Any help on this.

Hello @mmelndezlujn, can you update the branch from master

done :)

Hello @mmelndezlujn,
Sorry but I dont see the branch updated from master

Hello @mmelndezlujn, Can you provide write access to your branch. I'll try to resolve validation errors.

Hello @v-prasadboke, I am not sure if I can provide write access as I am not the repo owner.
@shainw could you help me with this, please? :)

Hi @shainw, Any help on this.

@v-prasadboke and @mmelndezlujn - We are not going to complete this PR.  There are too many file changes in one PR and there are more changes that are needed based on my comments.  I am going to take the changes and break them down into 5-6 file submissions and extend the mappings I called out as needed.  I am closing this and will reference this in the new PRs.


Menu activeElement / onSelect functionality - context api example

Active element via context API - example.
We let the user to decide the element's selector and we save it as active element in our context.
For example, the selector will be the label of our components.
We provide two things in its state:

activeElement: currently selected element, defined by the user
setActiveElement: method that gets a value (any value) and sets it to context's state

Check it out in storybook.
@liorheber @johanzilber @AmirAsaraf WDYT?

me and @johanzilber will merge this.
should add tests.
@AmirAsaraf @liorheber


Command line flag to display version

cmgr currently does not have a way to display what version it is.  This would be a handy addition for debugging issues between challenge developers who may not all be running the same version.  I would suggest a --version or -V to print a banner as the first line of output, while still running commands.

Thanks for the suggestion.  I just created a new release that implements function similar to what you suggested.  Specifically, cmgr version and cmgrd --version will print the version and exit.  If you want it to log the version while performing other functionality, then you can set the logging level to info (CMGR_LOGGING=info) and it will be the first item logged.
Note: Version information relies on injecting the git information at build time and will default to unknown unless built properly.  See the release action for how that is done.

Thanks for the suggestion.  I just created a new release that implements function similar to what you suggested.  Specifically, cmgr version and cmgrd --version will print the version and exit.  If you want it to log the version while performing other functionality, then you can set the logging level to info (CMGR_LOGGING=info) and it will be the first item logged.
Note: Version information relies on injecting the git information at build time and will default to unknown unless built properly.  See the release action for how that is done.


Gluon nn BatchNorm layer cannot ignore the beta

In mxnet symbol API, we cannot fix the beta to be 0. So, I tried to use the Gluon nn BatchNorm layer which allows setting center=False to ignore the beta term. However, When I use
bn = mx.nn.BatchNorm(scale=False, center=False)
I checked the mean of the output from this BatchNorm during training. I found that the mean is changing and also is significantly larger than 0 (e.g., it could be 0.7). Then, I looked at the implementation of the nn BatchNorm layer. It sets grad_req = 'null' and differentiable = False for beta when center = False. I have no clue why this is not working, or I got it wrong.

Hi @Will0622. I wasn't able to reproduce this issue with simple code samples. Could you provide a snippet for reproducing the issue?

@Will0622 closing for lack of activity. If this is still relevant, whenever you're ready, you can provide the information here and ping me to reopen the issue. Thanks.


MSBuild thinks a sln dependency is a reference

Steps to reproduce
I have a .NET 4.7 project which, as part of its build, runs a .NET Core CLI program to generate one of its source files using the BeforeBuild target and <Exec>. Because of this I want the generator to build before my project, so the .sln file has a dependency in the form of ProjectSection(ProjectDependencies) = postProject.
Expected behavior
The build works from within VS. I expect it to work from a command line MSBuild, because I in fact don't reference the .NET Core project, just call it as any other CLI tool. The fact that it's .NET Core is irrelevant, it could be C++.
Actual behavior
[GetReferenceNearestTargetFrameworkTask] C:\Program Files (x86)\Microsoft Visual Studio\2017\BuildTools\MSBuild\15.0\bin\amd64\Microsoft.Common.CurrentVersion.targets(1656, 5): Project 'C:\[snip...]\csharp_gen.csproj' targets 'netcoreapp2.1'. It cannot be referenced by a project that targets '.NETFramework,Version=v4.7'.
Environment data
msbuild /version output:
Microsoft (R) Build Engine version <IP_ADDRESS>72 for .NET Framework
Copyright (C) Microsoft Corporation. All rights reserved.

<IP_ADDRESS>72

OS info: Win7 x64, latest updates as of today
If applicable, version of the tool that invokes MSBuild (Visual Studio, dotnet CLI, etc):
msbuild.exe is being run standalone

Duplicate of #1915. This should be fixed for 15.8 by #3315, and https://github.com/Microsoft/msbuild/issues/2661#issuecomment-338808156 includes a workaround you can use today.


Can't insert tab anymore in editor

Hi,
I'm using DBeaver 6.3.2 CE as my most favorite SQL database manager and editor. For some reason I can't use tabs anymore for indenting my code. I already tried to enable/disalbe "Insert spaces for tabs" or change the indent size, no effect at all. Whenever I press TAB nothing happens in the editor.
The only way to have parts of the SQL code indented is by using "Format SQL".
Any hints why? Connection used is to a PostgreSQL DB.
Regards, Thomas

Unfortunately, can't reproduce it. Does it affect on any SQL expression? What is your OS?

It does not effect the expression itself, however, I cannot format the statement with indents myself. OS is MacOS High Sierra, Java is OpenJDK12, Dbeaver is 6.3.2 (latest).
Regards, Thomas

there is no update on issue more than a month.
Ticket closed.
If issue still reproducible for you - feel free to reopen the ticket


Subutai Plugin authentication failure on Bazaar

| Blueprint provisioning via Bazaar |
-------------------------------------
Please enter credentials Bazaar:
email:
<EMAIL_ADDRESS>Enter Bazaar password:

        <title>Oops. The requested route cannot be found.</title>
        <meta charset="UTF-8">

:(

Oops. The requested route cannot be found.

Back to homepage

Not Found
==> default: Running provisioner: cleanup...```

How to test:

vagrant init subutai/stretch-master
Put Subutai.json file next to the Vagrantfile
Use following user parameters in vagrant-subutai.yml

SUBUTAI_ENV: master
SUBUTAI_RAM: 8000
SUBUTAI_ENV_TYPE: bazaar

vagrant up

During the creation I faced the error:

Failed on master

The Bazaar replied Internal Server error. Bazaar should give the exact error message if vagrant plugin sends incorrect paramater.
About this issue created in the Bazaar repo https://github.com/optdyn/hub/issues/7223 .

Followed the instructions above.
Fixed in master

Followed the steps.
No errors were faced.
Fixed


Fixing camera read loc

fix https://github.com/microsoft/pxt-arcade/issues/5440
here's a build for it as it's easiest to just test it https://arcade.makecode.com/app/708640d9e59404f6d619b6d9e551c9854dfa2596-d43654d8b7
This makes it so we basically pass through to the sprites position when grabbing camera state - so the pause(0) hack we did is no longer necessary, and it's fine bumping the code out of the run code after game engine updates the camera back into an on game update if we want. Here's a version where I did that: https://arcade.makecode.com/app/708640d9e59404f6d619b6d9e551c9854dfa2596-d43654d8b7#pub:_FFLTaRKXePxE

We should make sure to test this with a bunch of games before releasing. we've regressed camera stuff before (though i expect this fixes many more problems than it causes)


teuthology-results: Be aware of all job statuses

We used to claim that every job that didn't pass or fail had 'hung'. That was a holdover from the pre-paddles era.
Now we can report 'dead', 'running', 'waiting', and 'queued'.
teuthology-results will now require a running paddles instance, but then again, so does scheduling jobs in the first place.

Example of output: http://paste2.org/NFkENFBY

@zmc that output looks much better! Perhaps we should format time to be H:M:S instead of just seconds? An extra line break between the jobs in the running and waiting sections would make that read easier as well, IMHO.

@andrewschoen good suggestions; updated!


Downstream metrics are not being recorded

Rancher Server Setup

Rancher version: v2.6.3-rc4

Information about the Cluster

Kubernetes version:
v1.20.11
Cluster Type (Local/Downstream):
downstream, custom cluster from quickstart-do terraform provider

Describe the bug

Navigate to <rancher-url>/metrics/<cluster-id> should show metrics, some of which will naturally be non-zero. Now, they are all zero which likely means metrics are not being recorded. This may be related to changes to rancher's use of caches for downstream clusters. This is the case whether or not monitoring is enabled. It also looks like the metrics for local may be wrong. Some values are non-zero, but others that I would expect to be non-zero are not.
To Reproduce

Provision a downstream cluster.
Navigate to <rancher-url>/metrics/<cluster-id>

Result
Will display all zero metrics like the following:
{"appRevisions":0,"catalogTemplateVersions":0,"projects":0,"configMaps":0,"secrets":0,"namespaces":0,"nodes":0,"roleBindings":0,"clusterRoleBindings":0}
Expected Result

Some non-zero metrics. Example:
{"appRevisions":0,"catalogTemplateVersions":0,"projects":0,"configMaps":76,"secrets":92,"namespaces":12,"nodes":1,"roleBindings":50,"clusterRoleBindings":96}

the endpoint worked initially, but after created a new project and attempting to navigate to the endpoint again, it never load. Here are some logs:
2021/12/10 23:46:39 [ERROR] Unknown error: Get "https://[redacted]/apis/management.cattle.io/v3/namespaces/user-mjb6g/preferences?timeout=15m0s": context canceled
2021/12/10 23:46:39 [ERROR] Unknown error: Get "https://[redacted]/api/v1/namespaces?includeObject=Object&limit=100000&timeout=15m0s": context canceled
2021/12/10 23:46:39 [ERROR] Unknown error: Get "https://[redacted]/apis/management.cattle.io/v3/fleetworkspaces?includeObject=Object&limit=100000&timeout=15m0s": context canceled
2021/12/10 23:46:39 [ERROR] Unknown error: Get "https://[redacted]/apis/management.cattle.io/v3/settings?includeObject=Object&limit=100000&timeout=15m0s": context canceled
2021/12/10 23:46:39 [ERROR] Error during subscribe websocket: close sent
2021/12/10 23:47:35 [ERROR] Error during subscribe websocket: close sent
2021/12/10 23:47:47 [ERROR] Error during subscribe websocket: close sent
2021/12/10 23:48:14 [INFO] Starting cluster controllers for c-9mjgv
2021/12/10 23:48:14 [INFO] Starting management.cattle.io/v3, Kind=SamlToken controller
E1210 23:48:14.757536      34 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.22.3-rancher.1/tools/cache/reflector.go:168: Failed to watch *v3.AppRevision: failed to list *v3.AppRevision: the server could not find the requested resource (get apprevisions.meta.k8s.io)
E1210 23:48:15.734139      34 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.22.3-rancher.1/tools/cache/reflector.go:168: Failed to watch *v3.AppRevision: failed to list *v3.AppRevision: the server could not find the requested resource (get apprevisions.meta.k8s.io)
E1210 23:48:17.471690      34 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.22.3-rancher.1/tools/cache/reflector.go:168: Failed to watch *v3.AppRevision: failed to list *v3.AppRevision: the server could not find the requested resource (get apprevisions.meta.k8s.io)
E1210 23:48:21.834771      34 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.22.3-rancher.1/tools/cache/reflector.go:168: Failed to watch *v3.AppRevision: failed to list *v3.AppRevision: the server could not find the requested resource (get apprevisions.meta.k8s.io)
E1210 23:48:28.557163      34 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.22.3-rancher.1/tools/cache/reflector.go:168: Failed to watch *v3.AppRevision: failed to list *v3.AppRevision: the server could not find the requested resource (get apprevisions.meta.k8s.io)
2021/12/10 23:48:42 [ERROR] Error during subscribe websocket: close sent
E1210 23:48:52.638990      34 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.22.3-rancher.1/tools/cache/reflector.go:168: Failed to watch *v3.AppRevision: failed to list *v3.AppRevision: the server could not find the requested resource (get apprevisions.meta.k8s.io)
2021/12/10 23:49:11 [ERROR] Error during subscribe websocket: close sent
E1210 23:49:32.785829      34 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.22.3-rancher.1/tools/cache/reflector.go:168: Failed to watch *v3.AppRevision: failed to list *v3.AppRevision: the server could not find the requested resource (get apprevisions.meta.k8s.io)
E1210 23:50:15.337144      34 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.22.3-rancher.1/tools/cache/reflector.go:168: Failed to watch *v3.AppRevision: failed to list *v3.AppRevision: the server could not find the requested resource (get apprevisions.meta.k8s.io)
E1210 23:51:00.282191      34 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.22.3-rancher.1/tools/cache/reflector.go:168: Failed to watch *v3.AppRevision: failed to list *v3.AppRevision: the server could not find the requested resource (get apprevisions.meta.k8s.io)
2021/12/10 23:51:16 [ERROR] Error during subscribe websocket: close sent
E1210 23:51:50.050282      34 reflector.go:139] pkg/mod/github.com/rancher/client-go@v1.22.3-rancher.1/tools/cache/reflector.go:168: Failed to watch *v3.AppRevision: failed to list *v3.AppRevision: the server could not find the requested resource (get apprevisions.meta.k8s.io)

Why is the type v3.AppRevision missing.

@ibuildthecloud this issue seems to be related to this commit: https://github.com/rancher/rancher/commit/0f084bf88bd7056686465dfd685152e549379ae9#diff-8b9c5a67f3c8ee7b7b23a1c4c37b181f8609b84f77e5af638fa6d674d09af32dR44. Also, that crd doesn't exist in downstream clusters but it didn't before either. I think it is somehow related to the namespaces not being initialized when the resourcequota register is deferred.

Validated fix. Metrics handler now works. Issue mentioned above is not caused by this. New issue is tracked here: https://github.com/rancher/rancher/issues/35880.


No, we don't do such kind of builds. And I'm afraid it won't work in Eclipse/OSGi environment.


Fix Apache Struts Jakarta - critical remote code execution (CVE-2017-9805)

https://lgtm.com/blog/apache_struts_CVE-2017-9805_announcement
Security researchers at lgtm.com have discovered a critical remote code execution vulnerability in Apache Struts — a popular open-source framework for developing web applications in the Java programming language. All versions of Struts since 2008 are affected; all web applications using the framework’s popular REST plugin are vulnerable. Shortly after the patched versions of Struts were released on 5 September, multiple working exploits were observed on various internet sites. Users are strongly advised to upgrade their Apache Struts components as a matter of urgency. This vulnerability has been addressed in Struts versions 2.3.34 and 2.5.13.
IPT 2.3.4 has Struts version 2.3.32

Thank you @bart-v
The IPT doesn't use the Struts REST plugin and therefore isn't affected by this particular RCE vulnerability. After careful review, I can also confirm that the version of Struts the IPT uses (2.3.32) is still secure meaning none of the vulnerabilities fixed in Struts versions 2.3.33 or 2.3.34 affect the IPT.


Add BOOST_COMPUTE_MAX_CL_VERSION to specify the newest version to use

This resolves https://github.com/boostorg/compute/issues/647. I was not able to push to https://github.com/amirshavit/compute/tree/dev_max_cl_ver, so that's why this is in new merge request. See https://github.com/boostorg/compute/pull/650 and my comments in it.

Coverage remained the same at 83.426% when pulling 17be2b8c694c3b3fd1ac1cdf2651401adccf7920 on haahh:dev_max_cl_ver into 6f9e6cf650f4fedb5670cfea2b3f70a584ccd8d2 on boostorg:develop.

Coverage remained the same at 83.699% when pulling 568e0fe5bb200fdba5ae760b145801104fe7cc52 on haahh:dev_max_cl_ver into 60a588955f945726e9a90ab0413f942afb354243 on boostorg:develop.

In https://github.com/boostorg/compute/pull/699/commits/568e0fe5bb200fdba5ae760b145801104fe7cc52 I used BOOST_COMPUTE_MAX_CL_VERSION macro and OpenCL 2.1 headers in Travis script, and everything works correctly.


Modbus sensor refactoring

Description:
The modbus sensor needed some love.
I have:

Moved the coil support to binary_sensor, since it is a 1-bit value.
Removed the bits part of the sensor register config, since this can be done more efficient with a template_sensor.
Removed the register support from the switch since it can be done with template_switch.
Removed unused functions and unnecessary overrides.
Moved the slave attribute to each register so that it's easier to communicate with several slaves.
Changed the registers and coils attributes from a dicts to lists.
Added a length attribute to the register sensor.
Changed from unit attribute to the more commonly used unit_of_measurement
Added voluptuous to all modbus components

I will add voluptuous in the next PR
I have not been able to test the binary_sensor or switch since my unit lacks coils, if anyone has a unit with coils I would appreciate some help!
Related issue (if applicable): fixes #
#3038
Pull request in home-assistant.io with documentation (if applicable): home-assistant/home-assistant.io#
Will be updated
Example entry for configuration.yaml (if applicable):
modbus:
  type: serial
  method: rtu
  port: /dev/ttyUSB0
  baudrate: 9600
  stopbits: 1
  bytesize: 8
  parity: N

sensor:
  - platform: modbus
    registers:
      - name: Fan Speed
        slave: 1
        register: 100
      - name: Temperature set
        slave: 1
        register: 206
      - name: Supply air
        unit_of_measurement: °C
        slave: 1
        register: 213
        scale: 0.1
        precision: 1
      - name: Extract air
        unit_of_measurement: °C
        slave: 1
        register: 214
        scale: 0.1
        precision: 1

binary_sensor:
  - platform: modbus
    coils:
      - name: Alarm 1
        slave: 2
        coil: 15

switch:
  - platform: modbus
    coils:
      - name: Heater
        slave: 1
        coil: 2

Checklist:
If user exposed functionality or configuration variables are added/changed:

[ ] Documentation added/updated in home-assistant.io

If code communicates with devices, web services, or a:

[x] Local tests with tox run successfully. Your PR cannot be merged unless tests pass

Any chance this can make it into .28?

Include #3252 in this PR and add schema to service

The switch is still to be done. Not ready for merge yet

The refactoring is done, except for fixes for future review comments.

Looks good overall, but I do not have any Modbus kit though. Would be nice if someone can help test it, but as long as the upstream library supports binary_sensor and switch I guess it should be ok

I found a modbus slave simulation tool, I can do some simple tests with that.

Managed to find a bug from pre-refactoring with the test tool (http://www.modbusdriver.com/diagslave.html). binary_sensor and switch are tested and works

Looks good! :dolphin:


Unable to open link Petstore Swagger Sample App

Please look into the issue .....

Cannot reproduce, http://petstore.swagger.io/ works.


Reflection fixes

In my case the missing class was GHIssueRename, but as it turns out, there are more. Hopefully the automated test based on Jandex will make it easier to spot those in the future.

@allcontributors add @yrodiere for code


Marketing around Perun

We need to gather feedback from current users (internally - knowledge sharing sessions and externally - other meet-ups), improve documentation and make a little more noise around perun in social media.

StackOverflow Open Source Advertising:

https://meta.stackoverflow.com/questions/362773/open-source-advertising-1h-2018