R/Python Chunks?

Does Weave support R/Python code chunks? Is there a best practice for using R/Python if you're not explicitly using RCall/PyCall?

For R I think that it would be possible to incorporate RCall support more tightly in Weave.  An advantage of RCall is that it provides many conversion methods for R objects to Julia.  At present RCall provides IJulia integration for plots.  In a Jupyter notebook including an RCall chunk that generates a plot results in the plot being displayed.  (i.e. it writes a .png or .svg file which is then included automatically in the notebook.)  I think a similar approach could be used in Weave.
Looking at https://github.com/JuliaInterop/RCall.jl/blob/master/src/ijulia.jl it seems that very little of that code is IJulia-specific.  I would be willing to work on adapting RCall and Weave to cooperate if someone (@mpastell ?) could point me in the right direction to adapt the Weave code.
Another possible point of integration between RCall and Weave is to automatically convert chunk enclosed in "r" and "" as
R"""
<block contents>
"""

Just my 2 cents, I work on JuliaCall, which embeds julia in R and provides the functionality for RMarkdown document to have julia chunks.
This can be done because knitr (the RMarkdown document package) provides ways for integrating language chunks other than R. I think a similar way can be incorporated into Weave quite easily utilizing julia's multiple dispatching.
When I browse the code of Weave, I think the run_code is the main function to weave all thing together.
https://github.com/JunoLab/Weave.jl/blob/b01b18ea2f824febe7742821dfc1829740769a5b/src/run.jl#L198
It should be easily extensible by allowing the run_code function to have a language parameter. So individual packages like RCall and PyCall can have their own run_code method for their specific languages like R and Python.
So Weave could have things like:
function run_code(lang::Lang(:julia), chunk::CodeChunk, report::Report, SandBox::Module)

And RCall and PyCall could have functions like
function run_code(lang::Lang(:R), chunk::CodeChunk, report::Report, SandBox::Module)

function run_code(lang::Lang(:python), chunk::CodeChunk, report::Report, SandBox::Module)

Or maybe instead of changing run_code to have language arguments, we could allow parse_input and capture_output to have their first arguments as languages. Maybe this is a better design?

Bump.  Any reactions from JunoLab members or @mpastell to this suggestion?

The approach outlined by @Non-Contradiction makes sense to me -- it would probably make sense to run_code(lang::Lang(:python) etc in a @require block in Weave.jl instead of in e.g. PyCall though.

In a Jupyter notebook including an RCall chunk that generates a plot results in the plot being displayed. (i.e. it writes a .png or .svg file which is then included automatically in the notebook.) I think a similar approach could be used in Weave.

That would be great to have. It seems like it should be relatively to do the relevant setup and post-execution tasks here with minimal refactoring in RCall.

@Non-Contradiction Would you have time to collaborate on adding this functionality?  I'll start but I would probably benefit from your looking at what I do and offering suggestions.

@dmbates  Yes, I am willing to collaborate for this functionality.

Perhaps it would be better to use an abstract Lang type and have specific languages inherit from the abstract type?  I have some suggestions in a document doc/src/overall_structure.md in https://github.com/dmbates/Weave.jl  Could you take a look @Non-Contradiction (and perhaps also @pfitzseb) to see if this is what you would have had in mind?

Sorry I messed up the notation. The thing originally in my mind was something like this:
julia> struct Lang{T} end

julia> Lang{:R}
Lang{:R}

julia> f(::Lang{T}) where T = T
f (generic function with 1 method)

julia> f(Lang{:R}())
:R

After more consideration, I think the abstract type way as in the overall_structure.md is more flexible and extensible and should be the way to go. For example, the run_code function does not seem to have any arguments for options currently,  but if we want to allow some options for R/Python/other languages, it is easy to have more fields for the specific language type.

I have a version that runs some examples in the RCall branch at https://github.com/dmbates/Weave.jl  This part is just an attempt to get the .jmd input to function as before but with a lang field that is an AbstractLanguage in the CodeChunk struct.  The CodeChunk struct is parameterized by the language, which is almost what @Non-Contradiction was suggesting.  I also named the capture groups in the codestart regular expression for MarkupInput just to make it easier to figure out what is where.
Changing the codestart regular expression for the markdown files will necessitate changing the code for noweb files, which don't have a language specification.  I haven't done that yet so some of the tests will error.
Before devoting more effort to this, can I get opinions on whether this approach seems reasonable?  The next step will be to write run_code and collect_results methods for CodeChunk{RLang} types.

Just bumping this thread --- would love to see support for RCall.jl

Bump - any news on this @dmbates or @Non-Contradiction ?

No progress from me as I haven't been using Weave.jl recently.

Gotcha @dmbates - do you happen to still have your fork around?
I would be happy to tinker with trying to get RCall-based blocks working within Weave .

@pfitzseb - I would really like to get this working for Weave.jl
Is there any interest in still having this in the Weave ecosystem?
My first priority would be to work with RCall.jl to get things working.

Sure. I don't really have an opinion on the best implementation for this, but would be happy to discuss if you open a PR that sketches out the functionality.


Please add "top aligned" .header .icon option

The default vertical-alignment for an icon inside a header is only "middle". Can we add a "top aligned" option? I would like to see some icons sit at the very top. (Also, padding-top needs to be 0 in this case)
.ui.header[class*="top aligned"] .icon {
  vertical-align: top !important;
  padding-top:0 !important;
}

https://jsfiddle.net/kmd1970/so9mrete/


Improve error messages and help information in the new test interface.

On the new test interface branch, do the following:

[ ] All uses of FilibusterGrpcTestRuntimeException should be replaced with a subclass with a hardcoded error message (and, taking a parameter of the cause, if necessary.). These subclasses should be specific enough that we can actually generate in the UI code specific enough to address the issue.  These exceptions should be documented with javadoc.
[ ] Constructors for FilibusterGrpcTestRuntimeException should be removed so this cannot be used directly.
[ ] In the HTML UI, we should have a box show up above the test, if it's a subclass of this type, that can conditionally provide a message, link to javadoc, and possible codegen on how to solve the issue.  We'll have to do this one exception subclass at a time.  Therefore, to start, enumerate each subclass you make below and then we'll figure out the proper text and where to link, etc.  I imagine I can help with the first couple, and then it will be easy enough for you to do the rest yourself.

for this, please push/checkin after you convert the exceptions before moving on to the UX/UI

we'll review and merge before moving on

For the HTML UI, these are the exception subclasses:

[ ] FilibusterGrpcAmbiguousFailureHandlingException
[ ] FilibusterGrpcAmbiguousThrowAndErrorPropagationException
[ ] FilibusterGrpcAssertionsDidNotHoldUnderErrorResponseException
[ ] FilibusterGrpcAssertionsForAssertOnExceptionFailedException
[ ] FilibusterGrpcAssertOnFaultException
[ ] FilibusterGrpcAssertTestBlockFailedException
[ ] FilibusterGrpcFailedRPCException
[ ] FilibusterGrpcInjectedFaultHasUnspecifiedFailureBehaviorException
[ ] FilibusterGrpcInjectedFaultHasUnspecifiedFailureBehaviorException
[ ] FilibusterGrpcMissingAssertionForStatusCodeException
[ ] FilibusterGrpcMultipleFaultsInjectedException
[ ] FilibusterGrpcReadOnlyRPCUsedOutsideAssertOnExceptionException
[ ] FilibusterGrpcSideEffectingRPCUsedOutsideAssertOnExceptionException
[ ] FilibusterGrpcStubbedRPCHasNoAssertionsException
[ ] FilibusterGrpcSuppressedStatusCodeException
[ ] FilibusterGrpcThrownExceptionHasUnspecifiedFailureBehaviorException

Perhaps a place to start with the UI work is to start with the FilibusterGrpcInvokedRPCUnimplementedException.  The idea here, is that if the test fails with this error, in the UI there's a box above the test execution that says "here's the possible ways to fix this" with a bullet list of what APIs they can use to fix it with a link to those APIs in the javadoc.  For this particular error, you'd link to https://filibuster-testing.github.io/filibuster-java-instrumentation/javadoc/cloud/filibuster/junit/statem/GrpcMock.html#stubFor(io.grpc.MethodDescriptor,ReqT,RespT)

Might be worthwhile to also link this in the text message in the exception itself so the URL is also printed to the console/log


@use at-rule of  module system in vue/cli3 error

Version
3.12.0
Environment info
System:
    OS: macOS High Sierra 10.13.4
    CPU: (4) x64 Intel(R) Core(TM) i5-7360U CPU @ 2.30GHz
  Binaries:
    Node: 12.11.1 - /usr/local/bin/node
    Yarn: 1.17.3 - ~/.yarn/bin/yarn
    npm: 6.6.0 - ~/.config/yarn/global/node_modules/.bin/npm
  Browsers:
    Chrome: 77.0.3865.120
    Firefox: Not Found
    Safari: 11.1
  npmPackages:
    @vue/babel-helper-vue-jsx-merge-props:  1.0.0
    @vue/babel-plugin-transform-vue-jsx:  1.0.0
    @vue/babel-preset-app:  3.12.0
    @vue/babel-preset-jsx:  1.1.1
    @vue/babel-sugar-functional-vue:  1.0.0
    @vue/babel-sugar-inject-h:  1.0.0
    @vue/babel-sugar-v-model:  1.1.1
    @vue/babel-sugar-v-on:  1.1.0
    @vue/cli-overlay:  3.12.0
    @vue/cli-plugin-babel: ^3.12.0 => 3.12.0
    @vue/cli-plugin-eslint: ^3.12.0 => 3.12.0
    @vue/cli-service: ^3.12.0 => 3.12.0
    @vue/cli-shared-utils:  3.12.0
    @vue/component-compiler-utils:  3.0.0
    @vue/eslint-config-airbnb: ^4.0.0 => 4.0.1
    @vue/preload-webpack-plugin:  1.1.1
    @vue/web-component-wrapper:  1.2.0
    eslint-plugin-vue: ^5.0.0 => 5.2.3 (4.7.1)
    vue: ^2.6.10 => 2.6.10
    vue-eslint-parser:  5.0.0 (2.0.3)
    vue-hot-reload-api:  2.3.4
    vue-loader:  15.7.1
    vue-style-loader:  4.1.2
    vue-template-compiler: ^2.6.10 => 2.6.10
    vue-template-es2015-compiler:  1.9.1

Steps to reproduce

vue create my-project
select default config
yarn add sass
add vue.config.js and code is: const sass = require('sass'); module.exports = { css: { loaderOptions: { sass: { implementation: sass, }, }, }, };
use @use at-rule in scss file

What is expected?
@use at-rule can be use success
What is actually happening?
@use error: Unknown at rule @usescss(unknownAtRules)

my vue.config.js code is:
const sass = require('sass'); module.exports = { css: { loaderOptions: { sass: { implementation: sass, }, }, }, };
my package.json is:
"sass": "^1.23.0", "sass-loader": "^8.0.0"
my var.scss file code is:
$--color-primary: #2166e7;
my page.scss file code is:
@use "var"

Please provide a runnable reproduction. If I'm not mistaken, the unknownAtRules error does not come from any of the dependencies but from vscode, you may need to report to them instead.

project in github url: https://github.com/GouJieShinee/sassModuleSystem

I'm sorry but I don't see any usage of @use in this project.

sorry, now you again see it. url: src/components/a.scss   .Thank you!

And what I get is

Still no unknownAtRules

Closing this issue because I don't think there's a bug here. At least no bug related to Vue CLI.

@GouJieShinee, or for anyone else in the furture, see the sass documentation on private members. This error looks entirely because $--color-primary is prefixed with -.

Hi guys, I have the same issue and my variable is called $font-size. The same error. I guess it's not related to sass' private members as pointed by @andybaacke.
When using @import in my vue.config.js everything goes fine.
sass: 1.25.0
sass-loader: 8.0.2

//This code does not work
loaderOptions: {
      sass: {
        prependData: `@use "~abstracts/variables"`
      }
    }

//This code works
loaderOptions: {
      sass: {
        prependData: `@import "~abstracts/variables"`
      }
    }

Any ideas?
Thanks


Expand CI jobs matrix and switch from Travis to Cirrus

In Travis, we have a simple jobs matrix which only tests each interface. All devices are run for an interface in a single job. This has caused problems for us as any failure in a specific device fails the entire test and does not build or run the test for the other devices. This results in a single failure not informing us whether a change made to another device causes the tests for that device to not be run. Instead we can expand this jobs matrix to test each device and interface combination individually.
Additionally we switch from Travis to Cirrus as Cirrus appears to be more responsive and easier to debug. Since Cirrus uses docker containers, it is possible to replicate the CI environment locally. Additionally, the docker images used can be specified by us and can even use dockerfiles present in the repo. This allows us to have absolute control over the testing environment which makes it much easier to get the tests to work.
In order to facilitate the expanded jobs matrix, setup_environment.sh is modified to only build each simulator/emulator or bitcoind when given the correct command line arguments. These are --trezor-1, --trezor-t, --coldcard, --ledger, --keepkey, --bitbox01. Also run_tests.py is modified to have the same arguments names for devices, namely --trezor is now --trezor-1 and --bitbox is --bitbox02. It also has a new --device-only option to disable the non-device unit tests.
This CI change reveals that the Coldcard and Trezor T tests and implementations are currently broken. It also revealed that our Ledger tests were slightly broken, but this was more easily resolved and has been fixed. For the Ledger, we switch to using Speculos' built in button automation instead of having a patch that does the button presses for us. Updating the configuration for that to include some additional text that is being displayed resolves the failures there. However, for Coldcard and Trezor T, the changes involved will be more complicated and so are left for a future PR.
For the final jobs matrix, we first have 3 jobs which don't need simulators/emulators or bitcoind:

Linter
Type checker
Non-device unit tests

Then we have a set of builder jobs. These don't test anything but instead build the simulators, emulators, bitcoind, and release distribution. The results of these builders are cached and passed down to the test jobs:

bitcoind builder
Builder for each device simulator/emulator
Linux and python distribution builder
Windows distribution builder (this is to test that our Wine build script works. The results are not used or tested.)

Lastly we have the test jobs. These take the cached bitcoind and cached device simulator (only for the device being tested) and runs the device tests for each interface. As some interfaces require the linux and python distributions, the cached results from those are also used in those jobs:

For each device

For each interface in library, cli, stdin, wheel installed cli, sdist installed cli, linux binary dist

Device test job

Merging as expected tests are failing.

Merging as expected tests are failing.


input image is not conformed

Question/Support Request

Dear FastSurfer experts, I'd like to run the tool using singularity and a GPU. My script looks like:
singularity exec --nv \
                 --no-home \
                 -B /imaging/rawT1/sub-01/T1:/data \
                 -B //imaging/fastsurfer_output:/output \
                 -B /usr/local/freesurfer:/fs \
                  /mnt/wsdata/softwares/fastsurfer-gpu.sif \
                  /fastsurfer/run_fastsurfer.sh \
                 --fs_license /fs/license.txt \
                 --t1 /data/T1.nii.gz \
                 --sid sub-01 --sd /output \
                 --seg_only

I am getting the following error:
/fastsurfer/FastSurferCNN /
python3.8 eval.py --in_name /data/T1.nii.gz --out_name /output/sub-01/mri/aparc.DKTatlas+aseg.deep.mgz --conformed_name /output/sub-01/mri/orig.mgz --order 1 --network_sagittal_path /fastsurfer/checkpoints/Sagittal_Weights_FastSurferCNN/ckpts/Epoch_30_training_state.pkl --network_axial_path /fastsurfer/checkpoints/Axial_Weights_FastSurferCNN/ckpts/Epoch_30_training_state.pkl --network_coronal_path /fastsurfer/checkpoints/Coronal_Weights_FastSurferCNN/ckpts/Epoch_30_training_state.pkl --batch_size 8 --simple_run --run_viewagg_on check
Reading volume /data/T1.nii.gz
The input image is not conformed.
A conformed image must satisfy the following criteria:
 - Dimensions 256x256x256:        False
 - Voxel size 1x1x1:              False
 - Orientation LIA:               False
 - Dtype uint8:                   False
Conforming image to UCHAR, RAS orientation, and 1mm isotropic voxels

ERROR: Min value in input is below 0.0!

However, the T1.nii.gz volume looks good when I open it with other tools.
Do you know where that error could come from?
Thank you,
f4b
Environment

FastSurfer Version: latest
FreeSurfer Version: 6.0
OS: Ubuntu 22.04.4 LTS
CPU: Intel(R) Core(TM) i9-10980XE CPU @ 3.00GHz
GPU: GeForce RTX 3080 Lite Hash Rate

For some reason your image has negative values, which usually should not happen. Maybe it was pre-processed, for example, cubic interpolation can produce negative values. If they are just slightly below zero, you can clamp them to zero.

Hi, this is a CUDA error and I don't think you can set these. It is strange that you have memory issues on a 10GB card. The question is what is already taking up the 7GiB. Are you running anything else on the GPU? When is this error happening (during the first segmentation network, or during view aggregation )?

The error happens right at the start.

Are you using the latest release official docker image (version 2.2.0) converted to singularity?
And also what is the resolution of your input image?
Are you running anything else on the GPU?  Maybe on the host system (window manager. ...)?


10/08/2018 17:43 : Create Pull Request for branch master -> prTesting1_2018100817

:white_check_mark: Validation status: passed

File
Status
Preview URL
Details

split/updateTestRef1.md
:white_check_mark:Succeeded

For more details, please refer to the build report.
Note: If you changed an existing file name or deleted a file, broken links in other files to the deleted or renamed file are listed only in the full build report.


Phasing X-chromosome variants

Hi, I ran triophase on a number of families, a really nice tool to take in the trio information as it's not so clear with shapeit4. It left me wondering, though, is there a reason why the X-chromosome isn't included in the analysis? I mean for the girls in the cohort. Thanks!

Hello,
Thank you for using trioPhaser! When I originally created trioPhaser I was doing research on rare diseases that would likely be inherited in a recessive manner through autosomal chromosomes. Therefore, I didn't code in the logic to take X chromosomes into consideration as X-linked, inherited, disease patterns were not on my radar.

Ok, thanks!


k9s skin option has been renamed

Using k9s and stylix gives me the following warning:
trace: warning: sven profile: The option `programs.k9s.skin' defined in `/nix/store/hkzfi73ddw7b54m50akpq4h322zn44c3-modules/k9s/hm.nix' has been renamed to `programs.k9s.skins.skin'.

Perhaps it is possible to adapt the path inside stylix to adapt to the new option name.

My bad, was wrong version of stylix.

Linked the pull request for future reference.


Add 'scopes' functionality

What kind of change does this PR introduce?
This allows a user to request scopes while signing up/in with an OAuth provider. In many cases, the entire reason applications use OAuth instead of just email/password is in order to access resources tied to those providers; for me, that means reading and writing from users' Github repos.
What is the current behavior?
The only scopes GoTrue requests from providers is for the user's email address
What is the new behavior?
GoTrue clients will be able to include scopes in their request and have those scopes reflected in the OAuth login screen.
Additional context
I'm not the best at Go so some of this might not be ideal (i.e. a.Provider(ctx, name, "") makes me a little uncomfortable), but I'm happy to edit.  I wasn't sure if this needed tests (redirectTo seems to only be asserted to match the config), but again happy to add them given some direction.
Once this gets pulled in, I'll go ahead and open a PR for gotrue-js so this can be used on the client like so:
const { user, session, error } = await supabase.auth.signIn({
  provider: 'github'
}, {
  scopes: 'repo notifications'
})

And after that I'll submit a PR for the docs in supabase

I tested with google and looks like the scopes are requested correctly however as it stands today there is no mechanism in place to actually use the oauth token returned to retrieve the additional data allowed by the inclusion of additional scopes, the reasons are:

the oauth token itself is not returned to the calling app (only a session/access token + gotrue refresh token)
we currently only fetch limited bits of data per provider as defined in the GetUserData method

I propose that when the /callback endpoint receives the oauth token, that we pass it all the way through and return it along with the response, so that the caller can then go ahead and make additional requests to the google API for the additional data
question: can the oauth token returned by google be used to make multiple requests for user data? I assume it can

trying to think what the returned value should be named: oauth_token seems best but people might get confused between that, and the access_token that is also returned. Possibly provider_token or external_provider_token

Ah, I didn't think of the actual oauth token making it through, that makes sense. I'll include that as provider_token, seems clear enough.
I imagine that you can reuse that token many times. At least in the case of the Github you can; I'll double-check with the other providers.

@awalias just to be sure, provider_token should be included at the top level alongside access_token right?

yea, I think this is the best way

@awalias @mateomorris What exactly is the content of provider_token? It doesn't seem to be a JWT token that I can use as Bearer to access for instance the Azure DevOps API, it seems to be a much bigger string. Is it not the access token given by the provider? And how would refreshing work?

@gl3nn it is the access token passed by the provider. I don't know why Azures would be so big or where you'd use it, but Github's token is 20 or so characters and you include it as-is in requests.
Can't speak to refreshing, I've just been saving the token on signin and it stays valid for a while.

Seems like the provider_token continues to be unusable in Azure as Bearer.
Hey ya'll, I've been browsing threads and online to attempt to leverage graph API from my Azure auth + supabase.
The closest info I've got so far was this thread https://discord.com/channels/839993398554656828/1225433690310447205/1257722645601058856 but I seem to be getting an invalid provider_token - ones that aren't JWT and therefore unusable.
Does anyone know what we should actually do with the provider token to make it valid JWT? Is an exchange required? What approach/scopes are best used with supabase to get usable tokens?


[CBS] - SAMPLE-AES encryption is not supported yet.

Please follow the guide below

You will be asked some questions and requested to provide some information, please read them carefully and answer honestly
Put an x into all the boxes [ ] relevant to your issue (like this: [x])
Use the Preview tab to see what your issue will actually look like

Make sure you are using the latest version: run youtube-dl --version and ensure your version is 2018.04.03. If it's not, read this FAQ entry and update. Issues with outdated version will be rejected.

[x] I've verified and I assure that I'm running youtube-dl 2018.04.03

Before submitting an issue make sure you have:

[x] At least skimmed through the README, most notably the FAQ and BUGS sections
[x] Searched the bugtracker for similar issues including closed ones
[x] Checked that provided video/audio/playlist URLs (if any) are alive and playable in a browser

What is the purpose of your issue?

[x] Bug report (encountered problems with youtube-dl)
[ ] Site support request (request for adding support for a new site)
[ ] Feature request (request for a new functionality)
[ ] Question
[ ] Other

Description of your issue, suggested solution and other information
Trying to download some videos from http://www.cbs.com will fail with the ffmpeg error SAMPLE-AES encryption is not supported yet.
One of the problematic videos: https://www.cbs.com/shows/macgyver/video/16Uktn9vb53zY72LuEbkXdq5VYVX0T3J/macgyver-riley-airplane/

Manually choose the download quality, selecting StreamPack (e.g. hls-6300) rather than HLS_FPS.
By the looks of things (the presence of HLS_FPS and DASH-CENC), it's possible that they may soon transition to a drm system.  If that happens, a corresponding download method won't be so easy.

I also found if I watched the network stream in chrome, I found a master.m3u8 in the stream that allowed me to download the whole thing. For instance, watching the network stream for "https://www.cbs.com/shows/madam-secretary/video/Ko2ii1MbS7GOI_s_Cze_gYzqf4lzI9Mz/madam-secretary-phase-two/" yielded "https://cbsios-vh.akamaihd.net/i/temp_hd_gallery_video/CBS_Production_Outlet_VMS/video_robot/CBS_Production_Entertainment/2018/03/29/1198216259920/CBS_MADAM_SECRETARY_417_AA_6CH_30M_1392609_,1628,4628,3128,2228,848,503,000.mp4.csmil/master.m3u8?hdnea=acl=/i/temp_hd_gallery_video/CBS_Production_Outlet_VMS/video_robot/CBS_Production_Entertainment/2018/03/29/1198216259920/CBS_MADAM_SECRETARY_417_AA_6CH_30M_1392609_*~exp=1523630150~hmac=0e83d92ccfb98416efd95169d4cdd1f8933385bff9dfc70fe0edb78be3fa63c2" which worked fine.

The link I found in chrome seems to be time dependant. I tried using it later and it failed.


Unused disk is created on change unless I specify volume and file.

Hello, I've noticed that when i change something new unused disk is created and used as "boot" which breaks my vm.
resource "proxmox_vm_qemu" "dc0test" {
  provider = "proxmox.dc0"
  target_node = "dc0n5"
  vmid = "8407"
  clone             = "Ubuntu-18.04LTS-wCI-4-tpl"
  full_clone      = true
  name              = "vm-1-tf-test"
  cores             = 2

  bootdisk = "scsi0"
  disk {
    size            = "5G"
    type            = "scsi"
    storage         = "vm-ssd"
    file = "vm-8407-disk-0"
    volume = "vm-ssd:vm-8407-disk-0"

  }
}

If I do it like this it works, however if I remove the following 2 lines it creates new disk and puts it as boot drive.
    file = "vm-8407-disk-0"
    volume = "vm-ssd:vm-8407-disk-0"

Terraform v0.14.3
Installed telmate/proxmox v2.6.6

@dabicata  why do you specify volume an file? it's redundant
also, removing them should create a new disk as you remove all the references to the working disk

@dabicata  why do you specify volume an file? it's redundant
also, removing them should create a new disk as you remove all the references to the working disk

@mleone87 I want the first time created disk after the cloning to stay, but if I don't specify the volume and file new disk is created every time i apply the terraform.

@mleone87 I want the first time created disk after the cloning to stay, but if I don't specify the volume and file new disk is created every time i apply the terraform.

mm that's quite unusual and breaks the purpose of terraform
can you post the resource definition that creates a new disk every time you apply it?

mm that's quite unusual and breaks the purpose of terraform
can you post the resource definition that creates a new disk every time you apply it?

mm that's quite unusual and breaks the purpose of terraform
can you post the resource definition that creates a new disk every time you apply it?

sure just remove the file and volume from the one i posted like this
resource "proxmox_vm_qemu" "dc0test" {
provider = "proxmox.dc0"
target_node = "dc0n5"
vmid = "8407"
clone             = "Ubuntu-18.04LTS-wCI-4-tpl"
full_clone      = true
name              = "vm-1-tf-test"
cores             = 2
bootdisk = "scsi0"
disk {
size            = "5G"
type            = "scsi"
storage         = "vm-ssd"
}
}

mm that's quite unusual and breaks the purpose of terraform
can you post the resource definition that creates a new disk every time you apply it?

sure just remove the file and volume from the one i posted like this
resource "proxmox_vm_qemu" "dc0test" {
provider = "proxmox.dc0"
target_node = "dc0n5"
vmid = "8407"
clone             = "Ubuntu-18.04LTS-wCI-4-tpl"
full_clone      = true
name              = "vm-1-tf-test"
cores             = 2
bootdisk = "scsi0"
disk {
size            = "5G"
type            = "scsi"
storage         = "vm-ssd"
}
}

That's definitely what is happening, new unused disk is created all the time if not strictly specified.

That's definitely what is happening, new unused disk is created all the time if not strictly specified.

@yukron
can you post your terraform resource definition and you clone template configuration?

@yukron
can you post your terraform resource definition and you clone template configuration?

Hey @mleone87 ! Looks like it was already fixed and I've just were using quite old provider version for some reason. :) Updated it and everything works fine now.

Hey @mleone87 ! Looks like it was already fixed and I've just were using quite old provider version for some reason. :) Updated it and everything works fine now.

This is happening to me as well using telmate/proxmox version 2.6.7. Proxmox VE is version 6.3-3 (without support license).
Here's my resource configuration:
resource "proxmox_vm_qemu" "k3s_node" {
  name        = "k3s-node"
  desc        = "K3S Node"
  target_node = var.target_node

  os_type         = "cloud-init"
  clone           = var.template_name
  agent           = 1
  boot            = "c"

  cpu     = "kvm64"
  cores   = 8
  sockets = 1
  memory  = 8192

  disk {
      type    = "scsi"
      storage = "local-lvm"
      size    = "12G"
      backup  = 1
      ssd     = 1
      discard = "on"
    }
  }

  network {
    model  = "virtio"
    bridge = "vmbr0"
    tag    = var.vlan_id
  }

  lifecycle {
    ignore_changes = [
      network,
    ]
  }

  # Cloud-init params
  ipconfig0 = "ip=${cidrhost(var.subnet, count.index + 1)}/24,gw=${var.gateway}"

  ssh_user = "ubuntu"
  sshkeys  = var.ssh_keys
}

The cloud-init aspect works perfectly so I think you can ignore that. I'm pretty sure I was able to reproduce without cloud-init too, but that was several weeks ago.
Every single time I apply any changes to the VM created by the above definition (for example change "ssd" to 0, or even only change the number of cpu cores), the "scsi0" (boot) device on the VM gets replaced by a completely new volume created in "local-lvm". Under "hardware", the old volume then appears as "unattached". And the VM can't boot of course.

Seems this is similar (or the same) as #283

Every single time I apply any changes to the VM created by the above definition (for example change "ssd" to 0, or even only change the number of cpu cores), the "scsi0" (boot) device on the VM gets replaced by a completely new volume created in "local-lvm". Under "hardware", the old volume then appears as "unattached". And the VM can't boot of course.

@gsomoza I have run into this also when trying to run plan with a second new VM in the configuration. I am new to using this resource and I was doing repeated apply/destroy cycles while testing cloud-init config. I commented out the new VM and still got this:
terraform plan
module.instance_student.null_resource.cicustom_snippets: Refreshing state... [id=6929365069489726756]
module.instance_student.proxmox_vm_qemu.vm: Refreshing state... [id=hive/qemu/100]

An execution plan has been generated and is shown below.
Resource actions are indicated with the following symbols:
  ~ update in-place

Terraform will perform the following actions:

  # module.instance_student.proxmox_vm_qemu.vm will be updated in-place
  ~ resource "proxmox_vm_qemu" "vm" {
        id                     = "hive/qemu/100"
        name                   = "student"
        # (30 unchanged attributes hidden)

      - disk {
          - backup       = 0 -> null
          - cache        = "none" -> null
          - file         = "vm-100-disk-0" -> null
          - format       = "raw" -> null
          - iothread     = 0 -> null
          - mbps         = 0 -> null
          - mbps_rd      = 0 -> null
          - mbps_rd_max  = 0 -> null
          - mbps_wr      = 0 -> null
          - mbps_wr_max  = 0 -> null
          - replicate    = 0 -> null
          - size         = "20G" -> null
          - slot         = 0 -> null
          - ssd          = 0 -> null
          - storage      = "local-zfs" -> null
          - storage_type = "zfspool" -> null
          - type         = "virtio" -> null
          - volume       = "local-zfs:vm-100-disk-0" -> null
        }

        # (1 unchanged block hidden)
    }

Plan: 0 to add, 1 to change, 0 to destroy.

------------------------------------------------------------------------

Note: You didn't specify an "-out" parameter to save this plan, so Terraform
can't guarantee that exactly these actions will be performed if
"terraform apply" is subsequently run.

The problem to me appears to be that when you create a clone, proxmox creates a disk in the cloning process (I don't have a disk in my config because I am only using the root disk from the clone and noticed an empty disk attached in an earlier apply so removed it) but when the provider updates state it does not know about the disk from the clone and wants to remove it.
I think what we need here is a fix or advice on how to marry the disk created from the clone to a disk that is defined in the resource configuration. I haven't had time to look through the code yet but I will tonight after work.

I had a few mins to check out the source code and found a link to this issue in the code:
https://github.com/Telmate/terraform-provider-proxmox/issues/239
I am not doing a full clone though so the issue might be different. Based on that issue and the code, it seems that the slot variable may be the key here:
  disk {
    slot = 0
    size = "20G"
    storage = "local-zfs"
    type = "virtio"
  }

If I include the above it seems to work consistently and without issues (been through a number of quick create/destroy and update cycles.
I am not sure if this solves your issue but this might need to be documented.

Nice, thanks for taking the time to do that! I'll check if that works for me too in the next few days.

Still reproducible (using version 2.7.4).
Any change to the VM (for example change cpu cores 2->1) lead to detaching original root disk and inserting empty one leaving machine unbootable.
Interesting fact:
Disc is always replaced with "raw" regardless of format of the initial disk and even if it is hardcoded as "qcow2" anyway it will be replaced with empty raw.
For example this is my disk config, and "qcow2" will be replaced with "raw" on "terraform apply"
  disk {
    type    = "scsi"
    storage = "shared"
    format  = "qcow2"
    size    = "16Gb"
    backup  = 1
    discard = "on"
  }

Still producable on
Terraform v 1.0.0
Telmate v 2.9.6
Proxmox v 7.1-11

Same issue here

We had the same error. After digging around i found the problem.
Terraform was reporting
[ERROR] setting state: disk.1.backup: '' expected type 'int', got unconvertible type 'bool', value: 'true'

And after that the volume name was not set in the tfstate file.
So when you don`t set the backup value (Witch is just a workaround) then the volume name should be in the tfstate file.

Same issue here
Terraform v1.3.0
Telmate v2.9.14
Proxmox v7.4-14

Happens for me sometimes as well. If I run terraform apply multiple times it will sometimes try to change the disk and sometimes not. Really inconsistent.

Same issue here
Terraform v1.6.3
Telmate v2.9.14
Proxmox v8.0.4

Configure the disk according to the new version syntax. It's worked for me. (link)
    disks {
        scsi {
            scsi0 {
                disk {
                    backup             = true
                    cache              = "none"
                    discard            = true
                    emulatessd         = true
                    iothread           = true
                    mbps_r_burst       = 0.0
                    mbps_r_concurrent  = 0.0
                    mbps_wr_burst      = 0.0
                    mbps_wr_concurrent = 0.0
                    replicate          = true
                    size               = 32
                    storage            = "local-lvm"
                }
            }
        }
    }


[archer env add] Slight clarification in help text

~/ecs/ecs-devx/testing/archer$ archer env add --help
Deploy a new environment to your project

Usage
  archer env add [name] [flags]

Flags
  -h, --help             help for add
      --prod             If the environment contains production services.
      --profile string   Name of the profile. Defaults to "default".

Global Flags
      --project string   Name of the project (required unless you're in a workspace).

Examples
  Create a test environment in your "default" AWS profile
  $ archer env add test

  Create a prod-iad environment using your "prod-admin" AWS profile
  $ archer env add prod-iad --profile prod-admin --prod

Perhaps could clarify the description to specify something to the effect of "adds environment with [name] to project". Maybe clarify in examples?

We updated it to "Create a new environment in your project." :D


fix query limiting based on accounts for when CLI is used

This caused the OWM integration problems, when adding a data source.

Pull Request Test Coverage Report for Build<PHONE_NUMBER>

1 of 1 (100.0%)  changed or added relevant line in 1 file are covered.
No unchanged relevant lines lost coverage.
Overall coverage remained the same at 68.466%

Totals

Change from base Build<PHONE_NUMBER>:
0.0%

Covered Lines:
6998

Relevant Lines:
9690

💛  - Coveralls


Feature/fdk 976 test coverage

NB! IKKE TA DENNE PULL REQUESTEN ENDA - TEST AV TESTING...

Jira issue link: [link]https://jira.brreg.no/browse/FDK-976

check applicable boxes

[ ] I have made tests to match the user stories
[x ] This code does not require tests that match user stories

Coverage decreased (-6.05%) to 32.23% when pulling f951aa2a936b8e9e47e1e47e48226bc0a970be5c on feature/FDK-976-test-coverage into 3be5824600c1966a25d5bc7fcabbf14cda415e84 on develop.


Remove address person

Coverage remained the same at 83.281% when pulling 1200719d9776fcc95ea9b6cc42341f4101b6881b on remove_address_person into b71a10a1d96e04bf21f8c69919586b80f3e6c99f on develop.


Post Installation Issue

Describe the bug
Just installed followed the guide and that is what I am seeing on the browser, how to fix it?
I have no programing skills, and just tried to follow the tutorial.
Screenshots

Server (please complete the following information):

Device: IIS 8
OS: Windows Server 2012 R2
Browser: All Browsers
Version 321

@MDrakes https://docs.microsoft.com/en-us/aspnet/core/host-and-deploy/iis/?view=aspnetcore-2.1&tabs=aspnetcore2x Give that a lookover please. Might not have the Hosting Core Bundle installed.

@unquietwiki
Thanks for your reply.
There is any shorter guide to install it? I really got lost on it.

@MDrakes https://www.microsoft.com/net/download/thank-you/dotnet-runtime-2.1.0-windows-hosting-bundle-installer
They don't make this easy. I'm presently unemployed as of the past Wednesday: might have a new job soon, but I may use some of the free-time to work on the self-hosting ticket. You're not the first to have this trouble.

@unquietwiki
I have those installed:
dotnet-hosting-2.1.0-win
dotnet-runtime-2.1.0-win-x64
dotnet-sdk-2.1.300-win-x64
And the webpage still the same

I'd check the application pool settings, and also edit the index.html file
to use the address of your website. F12 in the browser can show missing JS
calls.
On Thu, Jun 21, 2018, 11:49 AM MDrakes<EMAIL_ADDRESS>wrote:

@unquietwiki https://github.com/unquietwiki
I have those installed:
dotnet-hosting-2.1.0-win
dotnet-runtime-2.1.0-win-x64
dotnet-sdk-2.1.300-win-x64
And the webpage still the same
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/unosquare/passcore/issues/169#issuecomment-399205963,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA9fv6kb2QmI3jLjg1OIXXB1Dq_PiaPaks5t--qrgaJpZM4UyftX
.

That is my index.html:
`

<link href="manifest.json" rel="manifest">

<title>Loading . . .</title>

<link href="assets/styles/indigo-pink.css" rel="stylesheet" type="text/css">
<link href="assets/favicon.ico" rel="shortcut icon">

Where you installed the program, look for the index file in a subdirectory,
and edit that. There's a comment where to make the change.
On Thu, Jun 21, 2018, 12:15 PM MDrakes<EMAIL_ADDRESS>wrote:

That is my index.html:
`

Loading . . .

Loading Pass
core
.
.
.

 `
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/unosquare/passcore/issues/169#issuecomment-399213098,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA9fvzbwF_MyzThilEwmmmaJFhDoTYLWks5t-_DAgaJpZM4UyftX
.

Its is under "C:\inetpub\PassCore\wwwroot"

Yes. Edit that where it says to change the address to match your current
website. And please also verify you have an unmanaged appPool set to run in
that directory.
On Thu, Jun 21, 2018, 12:21 PM MDrakes<EMAIL_ADDRESS>wrote:

Its is under "C:\inetpub\PassCore\wwwroot"
—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
https://github.com/unosquare/passcore/issues/169#issuecomment-399214592,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AA9fv-b2TzrmLyt6RpDKTuLJrKPfna98ks5t-_IcgaJpZM4UyftX
.

Do you mind to help me on Skype?
I am a bit lost to find it on the index.html

Well,
I have tried to edit the html file, but even so, still the same.

@unquietwiki,
I redid it from the start, and now it seems to be working, just testing if it will change the password now.

Well...
Now I managed to make it display the stuff.
Now I am trying to set the "appsettings.json" file, like the "DefaultDomain" and some translations.
But now when I try to change the password, I got this error:


'Proceedures' spelling mistake on front page image

On hospitalrun.github.io/img/screenshot-mock-sm.jpg I can see 'Proceedures' being used twice.  Believe the correct spelling is 'Procedures'.

@jglovier Where did we get that image from?  Was that a mockup?

Yeah, it's from my Sketch files. I'll update it. I've got some changes to make to the button UI there anyway.


Cibuildwheel

Updated CI (#43)

This looks great to me.  Thanks for setting it up.  Would you like to merge this?
What do these lines achieve?  I see you've added them to all the files I added recently.
import os

os.chdir(os.path.dirname(__file__))

If you need to test the PyPI packaging then I'm all for it.  How about we go with version 0.7a1?  I'm sure we'll need to go through a few iterations before we get it right.
Cheers,
Matthew

What do these lines achieve? I see you've added them to all the files I added recently. I understand that they change the directory to the current file's directory, but why was that necessary?
import os

os.chdir(os.path.dirname(__file__))

The reason I added these lines is so that you wouldn't be required to run the tests from the /tests directory as you previously were, as for some reason pytest calls them from wherever it was executed from - therefore the tests fail as the requirements can't be found.
This also has the advantage that you can now simply call pytest from the root directory and it will automatically find the tests and run them.

@mattgwwalker Okay, theoretically, the way this should work is that we would pusblish a new version here on GitHub and CI should automatically produce the necessary wheels and publish them here and on PyPI - if it works correctly that is.


Improve Test Coverage for csp.py

The csp.py module has a lot of code but only a few tests defined in the corresponding test file. You can help by adding tests for some of the functions and methods.

is this issue still open?

can i still contribute to this issue?

Can I still contribute to this issue?


Create per-signal Arrow stream services

Three new stream services are created, dedicated to each signal.
Fixes #156.
The exporter has a new boolean EnableMixedSignals which causes it to use the ArrowStream for export, otherwise by default it uses the per-signal stream.
The exporter has both supported by default, and both modes can be disabled. Use DisableMixedSignals and DisableSeparateSignals.

@moh-osman3 @jaronoff97 @kristinapathak


Remove allow declaration in favour of anonymous import in cmake

Need to put the import on the same line or else cargo fmt in the CI breaks.


Improvement for k8s.io/docs/reference/using-api/deprecation-guide/

You could extend the migration guide with examples in a before/after style.

/language en
/kind feature
Thanks for this enhancement request @paschelino
We'll consider it.

I'm not sure that the before/after examples are a good fit for our reference docs. I like the idea for doing this somewhere on the site, but it'd be a big commitment to do this for every API deprecation.
I'm going to decline this on the basis that we don't have capacity to staff it.
If the level of contribution changes, we'd be happy to see this reopened.
/close


Add field_serializer to computed_field

Initial Checks

[X] I have searched Google & GitHub for similar requests and couldn't find anything
[X] I have read and followed the docs and still think this feature is missing

Description
A nice new feature in pydantic >= 2 is computed_field that includes properties into serialization methods. It would be nice, if possible, to use custom serializations in the properties as well. An example of desired versus actual behavior is shown below:
from pydantic import BaseModel, field_serializer, computed_field
from pydantic import BaseModel, field_serializer, computed_field

class Model(BaseModel):
    foo: str

    @computed_field
    @property
    def dummy_property(self) -> str:
        return self.foo + " bar"

    @field_serializer("dummy_property")
    def serialize_dummy_property(self, value):
        return value.upper()

if __name__ == "__main__":
    model = Model(foo="foo")
    print(model.model_dump())
    # Expected: {'foo': 'foo', 'dummy_property': 'FOO BAR'}
    # Actual: pydantic.errors.PydanticUserError: Decorators defined with incorrect fields

Affected Components

[ ] Compatibility between releases
[ ] Data validation/parsing
[X] Data serialization - .model_dump() and .model_dump_json()
[X] JSON Schema
[ ] Dataclasses
[ ] Model Config
[ ] Field Types - adding or changing a particular data type
[ ] Function validation decorator
[ ] Generic Models
[ ] Other Model behaviour - model_construct(), pickling, private attributes, ORM mode
[ ] Plugins and integration with other tools - mypy, FastAPI, python-devtools, Hypothesis, VS Code, PyCharm, etc.

Selected Assignee: @adriangb

Fixed in #6965


MultiWorkerMirroredStrategy training does not work with multiple epochs

System information

Have I written custom code (as opposed to using a stock example script provided in TensorFlow): Minor adaption of https://www.tensorflow.org/tutorials/distribute/multi_worker_with_keras
OS Platform and Distribution (e.g., Linux Ubuntu 16.04): RHEL 7.5
TensorFlow installed from (source or binary): source
TensorFlow version (use command below):2.1.0
Python version: 3.7.4
Bazel version (if compiling from source): 0.29.1
GCC/Compiler version (if compiling from source): 8.3.0
CUDA/cuDNN version: 10.1
GPU model and memory: K80

Describe the current behavior
Executing training over multiple epochs and workers as per the example fails with "Empty training data" and

WARNING:tensorflow:Your input ran out of data; interrupting training. Make sure that your dataset or generator can generate at least steps_per_epoch * epochs batches (in this case, 1407 batches). You may need to use the repeat() function when building your dataset.

Describe the expected behavior
Running training over multiple epochs automatically repeats the training data
Code to reproduce the issue
Pretty much the exact example code from the MultiWorkerDistributed tutorial:
#!/usr/bin/env python

import os
import json
import tensorflow_datasets as tfds
import tensorflow as tf
from slurm_utils import create_tf_config
tfds.disable_progress_bar()

BUFFER_SIZE = 10000
BATCH_SIZE = 64

def make_datasets_unbatched():
    # Scaling MNIST data from (0, 255] to (0., 1.]
    def scale(image, label):
        image = tf.cast(image, tf.float32)
        image /= 255
        return image, label

    datasets, info = tfds.load(name='mnist',
                               with_info=True,
                               as_supervised=True)

    return datasets['train'].map(scale).cache().shuffle(BUFFER_SIZE)

def build_and_compile_cnn_model():
    model = tf.keras.Sequential([
        tf.keras.layers.Conv2D(32,
                               3,
                               activation='relu',
                               input_shape=(28, 28, 1)),
        tf.keras.layers.MaxPooling2D(),
        tf.keras.layers.Flatten(),
        tf.keras.layers.Dense(64, activation='relu'),
        tf.keras.layers.Dense(10, activation='softmax')
    ])
    model.compile(loss=tf.keras.losses.sparse_categorical_crossentropy,
                  optimizer=tf.keras.optimizers.SGD(learning_rate=0.001),
                  metrics=['accuracy'])
    return model

tfConfig = create_tf_config(gpus_per_task=2)
print('Used Config: {}'.format(tfConfig))
os.environ['TF_CONFIG'] = json.dumps(tfConfig)

strategy = tf.distribute.experimental.MultiWorkerMirroredStrategy()
print('Number of workers: {}\nParameter devices: {}\nWorkers: {}'.format(
    strategy.num_replicas_in_sync, strategy.extended.parameter_devices,
    strategy.extended.worker_devices))

# Here the batch size scales up by number of workers since
# `tf.data.Dataset.batch` expects the global batch size.
GLOBAL_BATCH_SIZE = BATCH_SIZE * strategy.num_replicas_in_sync
with strategy.scope():
    # Creation of dataset, and model building/compiling need to be within
    # `strategy.scope()`.
    train_datasets = make_datasets_unbatched().batch(GLOBAL_BATCH_SIZE)
    multi_worker_model = build_and_compile_cnn_model()

multi_worker_model.fit(x=train_datasets, epochs=3)

Other info / logs
The above create_tf_config creates the following config from SLURM environment: {'cluster': {'worker': ['taurusa9:8888']}, 'task': {'type': 'worker', 'index': 0, 'trial': 1}, 'job': None}
Running with 1 epoch works without any other code changes

I may have found the cause to this issue: After iterating over a Dataset provided by tfds the iterator for that dataset is exhausted. There is some code here: https://github.com/tensorflow/tensorflow/blob/v2.1.0/tensorflow/python/keras/engine/data_adapter.py#L203-L208
The size is always unknown because a DatasetAdapter is used. The steps_per_epoch is not None, because this is required for MultiWorkerMirroredStrategy. Hence the iterator is never recreated leading to the mentioned issue.
I've seen that there were some changes, however https://github.com/tensorflow/tensorflow/commit/6be131d0860559954c42685a87c63f16cebb2185 does not fix the issue because cardinality returns UNKNOWN leading to NOT recreating the iterator.
Side note: Why is a Dataset implemented in a way so it does not know its size? The information is often (always?) available. See e.g. https://github.com/tensorflow/datasets/issues/1403

I met up with the same problem. But in a little different scenario. I used the for loop as
for epoch in range(FLAGS.epoch):
        for train_data in train_dataset:
           ...

I log on every train batch. But the train stops before the last step of the first epoch. I guess that dataset can't fetch from the second epoch to fill the shuffle queue.

@372046933 That is a different problem. The issue I describe is with the default training loop. Can you open another issue with a full example? In case you are using MultiWorkerMirroredStrategy: The docs explain that this can NOT handle the trailing batch and you need to use repeat or explicit step/batch counts.

@Flamefire  I was using custom training loop, i.e. there is no model.fit. Also, I just checked the failing point, it's far from the last batch. Anyway, it seems a different problem

I met up with the same problem. But in a little different scenario. I used the for loop as
for epoch in range(FLAGS.epoch):
        for train_data in train_dataset:
           ...

I log on every train batch. But the train stops before the last step of the first epoch. I guess that dataset can't fetch from the second epoch to fill the shuffle queue.

I logged batch_size on every iteration, and found that the stopped position have smaller batch_size than FLAGS.batch_size @Flamefire , Do you think this is a duplicate issue

Your issue is different as I wrote in https://github.com/tensorflow/tensorflow/issues/36153#issuecomment-590736823 because you use a custom training loop. Please open another issue after reading that comment again and verifying that you are NOT using your loop inside MultiWorkerMirroredStrategy scope which is documented not to work if the last batch is smaller than the others. In case of doubt open a new issue with ALL information instead of adding half-information to an existing issue as this makes it MUCH easier to reason about your problem.

@Flamefire I have just opened an issue https://github.com/tensorflow/tensorflow/issues/37112 . Thanks for your help.

This is a known issue that we are working on - MultiWorkerMirroredStrategy doesn't handle last partial batch correctly. To remedy the error, please pass steps_per_epoch argument (and use repeat in your dataset accordingly for multiple epochs). We've updated the tutorial with these details.
https://www.tensorflow.org/tutorials/distribute/multi_worker_with_keras#train_the_model_with_multiworkermirroredstrategy
We expect to have this fixed by TF 2.3

Updating this thread as the steps_per_epoch requirement with MWMS has been lifted and the tutorial has been updated again.
For more info on distributed input, see this guide.
I'll close the issue now, but feel free to reopen if something is still unanswered.


Add code.stacktrace atttribute

Changes
There are use cases when it's desirable to collect a stacktrace that is not necessarily attached to an exception (e.g. to identify the exact stack of a span).
This PR proposes a new attribute code.stacktrace for the above-mentioned  use cases.
Merge requirement checklist

[x] CONTRIBUTING.md guidelines followed.
[ ] CHANGELOG.md updated for non-trivial changes.
[ ] schema-next.yaml updated with changes to existing conventions. (N/A)

Would we deprecate exception.stacktrace in favor of this generalization?

@trask I wasn't intending to imply changes to exception.stacktrace with that, but I'm open to it if we want to. code.stacktrace would cover other non-exception-related use cases. Also as you can see in the example value in this case the exception message is not present here.
But, you are right that code.stacktrace is a more general attribute that theoretically could be reused / referenced in the exception semantic conventions.

Would we deprecate exception.stacktrace in favor of this generalization?

Re-using a generic stacktrace field might be another option (hypothetical until there's progress on #339).

Also as you can see in the example value in this case the exception message is not present here.

👍

I didn't read everything, but please note that exception.stacktrace is not a plain stacktrace but the default detailed textual exception representation (including, usually, exception type, message, caused-by, etc)

I didn't read everything, but please note that exception.stacktrace is not a plain stacktrace but the default detailed textual exception representation (including, usually, exception type, message, caused-by, etc). There was a long discussion about the name (IIRC I was strongly against exceptions.stacktrace since in many languages there is also the possibility to get a textual representation of just the exception stacktrace), but there is no other common name for that concept.

Thanks @Oberon00 , that's also how I understood exception.stacktrace. For code.stacktrace the intention is to capture the textual representation of just the exception stacktrace. What do you think in general about the proposal in this PR?

should this have a change log entry?


HttpResponse wrong import

ngx-restangular/lib/ngx-restangular-http.d.ts(3,27): error TS2307: Cannot find module '@angular/common/http/src/response'.
I see that you already fixed that in repo - can you tell me when you will deploy it to npm? Without that upgrade to angular8 is not possible

Me too!

Repo looks like abondoned, isn't it?

I made a PR proposal to resolve this issue.
#174
Waiting for some feedback

You can at this moment install version - 5.0.0-rc1 - it has fix for that issue


Unable to complete quick tutorial

So I've done all the steps outlined in the quick tutorial on a fresh amazon linux box.
I'm able to hit the generic static route, but when I try and visit the google maps site, I get an nginx 404 page.

        <title>404 Not Found</title>

404 Not Found

        nginx

I don't have an /opt/api-umbrella/etc/nginx/backends.conf
I ran a sudo /etc/init.d/api-umbrella restart and that didn't seem to make a difference
I tried both localhost and the specific domain and recieved the same results from both.

in the nginx log I see
2017-10-12T21:45:08.24280 2017/10/12 21:45:08 [error] 27389#0: *291146 "/opt/api-umbrella/embedded/apps/static-site/current/build/googleapis/index.html" is not found (2: No such file or directory), client: <IP_ADDRESS>, server: _, request: "GET /googleapis/ HTTP/1.1", host: "api.brivity-staging.com"

Is it trying to hit a static site when I set up an api backend?

Here's what my backend config looks like:
(config)[https://i.imgur.com/nX76cXd.png]

Hello! This sounds like a mismatch between the "Frontend Host" setting on the API backend and the host you're running it on. You said you tried localhost and the actual hostname, but just to double check, can you try:

Changing the "Frontend Host" to whatever domain you're currently accessing your instance at. Then be sure to publish the changes (it's easy to forget that step), and try again.
If that doesn't work, can you try changing the "Frontend Host" to a wildcard *, publish the changes, and try again?

But give a shout if it's still not working.

The wildcard * did the trick thanks for pointing that out! This was so easy to set up, now on to trying to build a cluster!


[CHALLENGE SUBMISSION]

Please provide the following information for your submission:
What is your name? (First, Last)
Niall Kelly
Where is your GitHub Repo ?(With your challenge solution)
https://github.com/nkelly75/25-days-of-serverless/tree/master/day03
What Challenge is this for? (Challenge number between 1 and 25)
3
(Optional) Anything else we should know? e.g., language used, location, blog post?
Used node.js function and Table Storage. Also simple jest tests. More details in README.md

THANK YOU FOR YOUR #25DaysOfServerless SUBMISSION
We checked out your repository.
We're thrilled to say your solution is now listed in our Hall of Fame
Thank you for your contributions!
This issue is now resolved! 🎉


Refactors actions for future naming convention

Problem

Looking to the future, we should decide on a consistent naming-convention.
Solution

Uses setup-${language} for setup actions.
Makes actions specific to IaaS.
Adds patterns to wrap actions into pre-prescribed flows.

Breaking Changes

Moves npm-setup to setup-node for future consistency
Removes the npm-run action
Renames the deploy-static-assets to deploy-to-s3-bucket

@shopsmart/web-team

To see the specific tasks where the Asana app for GitHub is being used, see below:

https://app.asana.com/0/0/1201719084754787

The policy was not attached to the IAM role.  🤦

Hmmm... The original was fine and the revert was fine, but I can't approve the original a second time.

😅 Sorry, IAM permissions are hard.

It's fine.  This is becoming fun.

OK all done.  Just waiting for green from checks once more.


Help with diagnosing error

I am unsure if this is the right place to ask but I am running into an error that doesn't tell me where it happened, just the file it happened in. It appears to be the python end of the compiler but I don't know if that is correct.
The command used to compile the files: cythonize *.pyx --inplace -3
Here's the error:
[1/1] Cythonizing C:\My files\Programming\Python\Games\Game 3\lib\front__lasers.pyx
Traceback (most recent call last):
  File "c:\users\user\appdata\local\programs\python\python38\lib\runpy.py", line 194, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "c:\users\user\appdata\local\programs\python\python38\lib\runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "C:\Users\user\AppData\Local\Programs\Python\Python38\Scripts\cythonize.exe\__main__.py", line 7, in <module>
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Build\Cythonize.py", line 223, in main
    cython_compile(path, options)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Build\Cythonize.py", line 97, in cython_compile
    ext_modules = cythonize(
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Build\Dependencies.py", line 1102, in cythonize
    cythonize_one(*args)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Build\Dependencies.py", line 1208, in cythonize_one
    result = compile_single(pyx_file, options, full_module_name=full_module_name)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\Main.py", line 727, in compile_single
    return run_pipeline(source, options, full_module_name)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\Main.py", line 515, in run_pipeline
    err, enddata = Pipeline.run_pipeline(pipeline, source)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\Pipeline.py", line 355, in run_pipeline
    data = run(phase, data)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\Pipeline.py", line 335, in run
    return phase(data)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\Pipeline.py", line 52, in generate_pyx_code_stage
    module_node.process_implementation(options, result)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\ModuleNode.py", line 143, in process_implementation
    self.generate_c_code(env, options, result)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\ModuleNode.py", line 398, in generate_c_code
    self.generate_module_init_func(modules[:-1], env, globalstate['init_module'])
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\ModuleNode.py", line 2474, in generate_module_init_func
    self.body.generate_execution_code(code)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\Nodes.py", line 448, in generate_execution_code
    stat.generate_execution_code(code)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\Nodes.py", line 448, in generate_execution_code
    stat.generate_execution_code(code)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\Nodes.py", line 4860, in generate_execution_code
    self.body.generate_execution_code(code)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\Nodes.py", line 448, in generate_execution_code
    stat.generate_execution_code(code)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\Nodes.py", line 5186, in generate_execution_code
    self.generate_assignment_code(code)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\Nodes.py", line 5483, in generate_assignment_code
    self.lhs.generate_assignment_code(self.rhs, code)
  File "c:\users\user\appdata\local\programs\python\python38\lib\site-packages\Cython\Compiler\ExprNodes.py", line 2292, in generate_assignment_code
    assert entry.type.is_pyobject, "Python global or builtin not a Python object"
AssertionError: Python global or builtin not a Python object

This is a bug in the sense that it gives internal compiler errors rather that a useful message telling you what's wrong. However, there's definitely little we can tell from the details you've given. You could try:

The standard debugging technique of progressively removing code from your source file until you find out what bit's causing it.
Upgrade Cython to the 3.0 alpha branch (I think error reporting has been improved a bit, or the underlying issue may have been fixed).
If you're prepared to get into the Cython code then add  + str(self.pos) to the assertion line and that should given you more information. You may need to recompile.

Where did you get self.pos from? Many of the classes in this file have an attribute of pos and I don't think the error message mentioned anything about it.

All the

Where did you get self.pos from? Many of the classes in this file have an attribute of pos and I don't think the error message mentioned anything about it.

All the nodes store a pos attribute to represent where in the source code they come from. It's just an internal detail used for error reporting.

The bug of showing this type of error still stands so I won't close the issue myself.

Could you show the chunk of code that produces the error?

Could you show the chunk of code that produces the error?

cdef class A:
    COLOR: colors.RGBType = None # For whatever reason this is considered ok, but not the one directly below.
    DENSITY:float = None # Here is what used to be the culprit, the type hinting. Somehow.
    SPREAD = None
    # rest of the class goes here

cdef class B(A):
    COLOR: colors.RGBType = colors.blue
    DENSITY:float = 1
    SPREAD = 0
    # rest of the class goes here

cdef class C(B):
    SPREAD = 10
    # rest of the class goes here

cdef class B2(A):
    COLOR: colors.RGBType = colors.red
    DENSITY:float = 0.5
    SPREAD = 10
    # rest of the class goes here

cdef class C2(B2):
    SPREAD = 50
    # rest of the class goes here

Sorry I'm not sure if these mock up class names are easy to read. I'll edit this comment if you like.

Thanks.
For what it's worth I can reproduce the error with:
cdef class A:
    DENSITY:float = 0.5

but not with Density:float = None which just gives me Cannot assign None to double (as expected). I think the issue is type-hinted variables like this become instance variables rather than class variables for a cdef class, so it doesn't make sense to assign anything to them.
But the error message should definitely be better

Yea it makes a lot more sense now, but as you said the error message should definitely be better. Thanks for your help.


Add the following server fix version to download pages

I have built a version that can run on 1.20.1 forge server. You can add this file to the download pages if it is possible.
我编译了一个1.20.1forge服务器修复版，可以的话加到下载页里.
https://wwtm.lanzouq.com/iM3du1625p3i

@kettle-7 Could you please have a look at this file I have built?

建议你直接开 Pull Request 去把你的代码提交合并请求，而不是直接丢一个二进制文件。
I suggest you could open a pull request to merge your code into the repo instead of just giving a binary file.

Yeah sending binary files is a great way to make people think you're up to no good lol

but 1.20.x will be supported in 4.0.0; i don't think there's plans to support servers with 3.x and 1.20.x

MTR 3.2.2 hotfix-2 for Forge should have fixed the issue


Unable to change flow status/Turn on

Hi there,
I have been trying to turn on flow from PowerShell script and also from c# but  every time I try to run my code I get this below issue.
I am using Service principal user for this.

Doesn't matter what ever I do, this doesn't seem to be working but strange thing is I am able to turn flow on/off in postman.
Can anyone please help on this, it is big blocker for me.

@Seshan-Dixit Thanks for using Power Automate. This issue sounds specific to your scenario. Kindly contact Microsoft Support for help: https://preview.flow.microsoft.com/en-us/support/. This forum is for documentation issues only.


[Android] zeroconf.watch event with service without ipv4Addresses

Hi becvert,
I've a problem using your plugin with Android device. In particular, I receive, on "watch", event without ipv4Addresses; at first call, I can simply check if service does not contain ipv4Addresses (because I receive duplicate service, one with ipv4Addresses, one without ipv4Addresses). When I go out and return in a app page that use zeroconf, it returns only service without ipv4Addresses. How can I resolve this? This is my code:
  ionViewDidLoad(){
    var self = this;
    this.platform.ready().then(() =>{
      if((<any>window).cordova && (<any>window).cordova.plugins){
        var zeroconf = (<any>window).cordova.plugins.zeroconf;
        zeroconf.registerAddressFamily = 'ipv4'; // or 'ipv6' ('any' by default)
        zeroconf.watchAddressFamily = 'ipv4'; // or 'ipv6' ('any' by default)
        zeroconf.watch('_myservice._tcp.', 'local.',
          function(result:any) {
            var exists_name = false;
            for(var i = 0; i < self.List.length; i++){
              if(self.List[i].name == result.service.name)
                exists_name = true;
            }
            if(!exists_name && result.service.ipv4Addresses.length > 0){
              self.List.push(result.service);
              self.zone.run(() => { }); // update ngFor externally
            }
          },
          function(err:any){
              console.log("err: "+err)
            }
          );
        }
    })

      var self = this;
      var foo_timeout2 = true;
      setTimeout(
        function(){
          if(foo_timeout2){
            self.timeElapsed = true;
          }
      },10000);
  }

I'm using Ionic (3.13.0 but same problem with previous versions), tested on Samsung Galaxy S4 (Android 5.0.1) and Wiko Fever (Android 6.0).
Thanks for help!

check that result.action == 'resolved'?

At first time, when plugin find a device, it gives me action == "resolved", but second time that I use it, it gives me only action == "added".

by second time does it mean you 'paused' the app and then you resumed it? or you left if for good and then reopened it?
does ionViewDidLoad is call again on resume?

No, I mean that I change page the I return in the page that I call zeroconf plugin. Yes, ionViewDidLoad is called again.

Just ran into the same problem. action == "resolved" is only returned on the first watch attempt. Any consecutive watch just returns action == "added". zeroconf.unwatch() does not seem to help. But after zeroconf.stop() I once again receive another action == "resolved".
(Android 7.1.2 / cordova-android 6.3.0)

I'm running into this problem, I think.
reInit() doesn't seem to help, and sometimes even reloading the app doesn't seem to change anything either... In fact, it seems that if I start my service and register it before launching the app, I only receive the "added" events without the IP addresses.
Interestingly, I only had this problem when running on the ad-hoc wifi of my android device; when both the device and my service are running on a local wifi network it seems to work just fine.

@shader can you cast some light on your network topologies for both working and non-working scenarios?
@becvert I wonder if the OS is having trouble resolving IP addresses when using a particular network adapter configuration. Could this be caused by lack of DHCP?

@emcniece I have no idea :confused:

Closing old issue. Feel free to reopen.


Mysql: add Encode impl for &[T]

Is your feature request related to a problem? Please describe.
I was looking for an easy way to do bulk SELECTs by passing in an array of values (in my case, integer primary keys). I came up with this query:
SELECT id, username, first_name, last_name, profile_photo_url
        FROM UserProfiles
        WHERE id IN (?);

I went on to find that the Encode impl for &[T] was only present for Postgres
Describe the solution you'd like
Basically, I want impl<'q, T> Encode<'q, Mysql> for &[T] where T: Encode<'q, Mysql>
Describe alternatives you've considered
The alternative is to just make single queries in a loop. Another alternative is to build a dynamic query where I append OR id == ? to the where clause for every id I want to grab.
Additional context
None

Those impls exist for Postgres because it supports arrays as a native datatype. MySQL does not.
To support binding an array in that case, we'd have to implement some sort of comma-expansion which is a planned feature covered by #875.


Error: Cannot find module 'prettier/parser-babylon'

Error: Cannot find module 'prettier/parser-babylon'
Require stack:
- ./node_modules/prettier-plugin-sorted/dist/prettier-plugin-sorted.cjs.development.js
- ./node_modules/prettier-plugin-sorted/dist/index.js
- ./node_modules/prettier/bin-prettier.js

I'm pretty sure this is caused by the deprecated parser in prettier 1.16.0. It was removed in prettier 2.0

Same issue


Data and Insight Hub AWS Account Creation

Environment details
Application Name
data-and-insight-wepi

GitHub team slug
data-and-insight-hub

Environments

[x] Development
[x] Test
[x] Preproduction
[x] Production

Tags

tag
value

application
data-and-insight-wepi

business-unit
HQ

owner
<EMAIL_ADDRESS>

Networking options
Connectivity
Subnet sets

[x] General - this application will use the same subnet as other applications in your business unit
[ ] Isolated - this application has highly sensitive data which must have its own isolated subnet

How do users connect to the application?

[x] Over the public internet
[ ] With a purple cabled device (please give details)
[x] With a MoJ Official device

Connectivity to other applications or external parties

Additional features

Business Justification for AWS Account Creation.docx

[ ] Additional VPC Endpoints
[ ] Extended DNS Zones
[ ] Other - please specify

Other information

Hi Team - can anyone review the ticket and feedback if any errors or if anything needs updating which has not been correctly filled out?
Thanks

Discussed in planning - we'll cover the account creation in development only in this sprint, as part of our goal to refresh our account creation documentation

Supplied github team slug was incorrect - should be data-and-insights-hub
(https://github.com/orgs/ministryofjustice/teams/data-and-insights-hub)


Load from 2d array within vmap results in two gathers rather than just one

import jax
import jax.numpy as np
import numpy as onp

def test(arr, x, y):
  return arr[x, y]

rand_x = onp.random.randint(0, 200, size=1024)
rand_y = onp.random.randint(0, 200, size=1024)
rand_arr = onp.random.uniform(0, 1, size=(200,200))
test_vmap = jax.vmap(test, in_axes=(None, 0, 0))
jax.jit(test_vmap)(rand_arr, rand_x, rand_y)

The jax.jit results in an XLA computation with two gathers, but the expression can be implemented with just one.

I am not blocked on this, because I've worked around it by flattening the array and doing x * width + y.  But this is not ideal because it forces a layout upon XLA.  Also this is something that nobody other than an XLA expert is going to notice and work around in their code.

Just adding more info to this: this behavior is because of how we implemented NumPy indexing in jax.numpy._rewriting_take, in that we basically handle one index at a time just for simplicity's sake (and because that code predates the Scatter and Gather HLOs!). We have slightly "better" logic in other places in that it handles NumPy indexing and produces a single Gather/Scatter, but it's not as complete yet.
I think we always hoped that XLA would fuse multiple Gathers / slices together under a jit. How tricky is that?

I think we always hoped that XLA would fuse multiple Gathers / slices together under a jit. How tricky is that?

It's certainly possible, but not trivial.  If it was simply gather-of-gather that would be one thing (still nontrivial), but I'm observing it's gather-of-reshape-of-gather, and now this is "interesting".
I generally err on implementing these kinds of optimizations in the compiler even if it's somewhat complicated, because that's what it's there for.  But OTOH I don't know how hard it would be to change this on your end.


Clean up ng comp lib docs

Changes proposed in this Pull Request:

Change all the scorecard to score-card
Pretty everything
Clean up the docs for HTML escape chars
Double-check component API readme to have them line up with what's implemented in the code and that of the React API
Bump up version to 2.0.0

Waiting for an update in ng theme

@joebochill I am afraid that I have to add the scorecard list padding back; have to do that to match with React style
Let me know what you think and then I will change those examples in the storybook.
With padding:

Without padding:

@huayunh the padding looks fine. The egregious one was in the action row at the bottom because it affected the vertical centering of the text and icon.

@huayunh the padding looks fine. The egregious one was in the action row at the bottom because it affected the vertical centering of the text and icon.

I changed the action row to info list item, so that just went away.


Problem: validation runs redundant queries

Solution: when a transaction is stored, the system splits it in three
components, data, metadata, and the other fields of the transaction.
When the system retrieves a transaction, it needs to make three
different queries to reconstruct the original transaction. If a
transaction does not exist, the system does three queries anyway, even
if just one query is enough. This patch fixes this by doing the
additional queries if and only if the transaction exists.

Codecov Report

Merging #2409 into master will not change coverage.
The diff coverage is 100%.

@@          Coverage Diff           @@
##           master   #2409   +/-   ##
======================================
  Coverage    86.9%   86.9%
======================================
  Files          38      38
  Lines        2169    2169
======================================
  Hits         1885    1885
  Misses        284     284


Unable to build on Windows

Trying to build on Windows, getting this from go-systemd. I'm wondering how bad you depend on go-systemd. Would love a WIndows build....
C:\Users\rober_000\Documents>go build github.com/skynetservices/skydns
# github.com/coreos/go-systemd/activation
C:\Projects\Go\src\github.com\coreos\go-systemd\activation\files.go:47: cannot use fd (type int) as type syscall.Handle in argument to syscall.CloseOnExec

Might be worth filing an upstream bug for this as well, so that it can at least compile on windows.
You can rip out the systemd stuff as you don't need it, however I won't be removing systemd from skydns. So you will need to carry this patch out of tree.

Thanks, I did that as well. I'll take a stab at taking out systemd, it was that or re-implement in C#. Appreciate your feedback.

Can't build on Alpine Linux either. There should be a way to compile it without systemd support.

I would merge a PR that disables systemd (compile time) on windows.


Documentation: Pocket Core Functional Tests Scope

Documentation For Pocket Core RC-0.6.0 Functional Tests Scope
Leader
[Emanuel Medrano: Support Engineering Specialist]
Date(s)
02/15/2021
Participants

[Emanuel Medrano: Support Engineering Specialist]

Survey
Category

[ ] Infrastructure
[x] Protocol/Blockchain Dev
[ ] App Solutions

LEVEL

[x] RC
[ ] STABLE

Opened in the right repo


Automated cherry pick of #1158: fix attach able storage

Cherry pick of #1158 on release/2.8.0.
#1158: fix attach able storage

/lgtm
/approve


Market: maybe incorrect default price filled into buy/sell box when clicking on a margin call order

Someone reported that when he clicked on a yellow order then clicked "buy" button directly (without checking of the price), the price in the new order (shown in block history) is much higher than the price shown in order book, and another strange thing, the final price he paid is between those two prices.
I guess when there is a yellow order shown on the order book (margin call orders?), when clicking on the order, the price filled into buy/sell box is probably incorrectly set to feed price.

This should be fixed now with the market update.


questions for the reproduction

your paper ''Bootstrapping Large Language Models for Radiology Report Generation''is so excellent that I want to reproduce your code from scratch, but I am confused about some of the configs, such as the config files for the iu-xray dataset and mimic dataset"align.yaml" and  "generate_then_refine.yaml". About this "
build_info:
storage: /path/to/mimic
unlabeled_annotation_path: /path/to/pubmed"
could you please tell me what is the type of the pubmed?Only reports or both images and reports? And how can I download the pubmed you used?Also, config.yaml for stage1 and stage2 in train_configs, regarding "ckpt: '/path/to/linear/layer'", how should I fill in this ckpt path correctly?

Hi, I also meet the same problem. Have you solved it now? If it is possible, shall we have a small discussion about that? thx a lot!

your paper ''Bootstrapping Large Language Models for Radiology Report Generation''is so excellent that I want to reproduce your code from scratch, but I am confused about some of the configs, such as the config files for the iu-xray dataset and mimic dataset"align.yaml" and "generate_then_refine.yaml". About this " build_info: storage: /path/to/mimic unlabeled_annotation_path: /path/to/pubmed" could you please tell me what is the type of the pubmed?Only reports or both images and reports? And how can I download the pubmed you used?Also, config.yaml for stage1 and stage2 in train_configs, regarding "ckpt: '/path/to/linear/layer'", how should I fill in this ckpt path correctly?

Hi, I also meet the same problem. Have you solved it now? If it is possible, shall we have a small discussion about that? thx a lot!


(FR) language chooser option for twitter GUI or tweetdeck

Loving twitter, kudos for your work, sorry for not knowing WHERE to ask this. Please help.
FeatureRequest:
use the lang=en field of a Status() object as chooser in the GUI
Why? My followers are not all English native speakers.
What? I would like to do such things:

show a homepage of an account but only their ENGLISH tweets
follow an account, but only subscribe to their ENGLISH tweets (i.e. mute everything else)
allow others to see on my account's home page that I enabled "FOLLOW in EN/DE", and thus let them follow a language of their choice among my tweeted languages.

(1.) one is REALLY easy. Just insert a ... WHERE lang=en ... into your SQL SELECT statement.
The next ideas (2.) and (3.) are increasingly more complicated. Still though - easy.
IF YOU cannot help, please point me to someone who could perhaps. Thanks.
I have more ideas which can use language in a useful way. But let's start here.
thanks a lot, have a great day! Andreas
the data exists, you just have to add a viewer
example
                            author = Obj
                      contributors = None
                       coordinates = None
                          entities = 0 symbols | 1 user_mentions | 0 hashtags | 1 urls
                    favorite_count = 0
                         favorited = False
                               geo = None
                                id = 117....
                            id_str = 117....
           in_reply_to_screen_name = None
             in_reply_to_status_id = None
         in_reply_to_status_id_str = None
               in_reply_to_user_id = None
           in_reply_to_user_id_str = None
                   is_quote_status = True
                              lang = en
                             place = None
                possibly_sensitive = False
                  quoted_status_id = 1176...
              quoted_status_id_str = 1176...
                     retweet_count = 2
                         retweeted = True
                              text = RT @...: ...
                         truncated = False
                              user = Obj

so far I have seen these properties:
lang = en
lang = de
lang = und

The last one makes me think there will be false negatives. But that is really no problem, initially.
your questions:
problem in one sentence:
my followers/following use English PLUS another language. I want to select "English only".
Expected behavior
A button on each homepage "show only English tweets"
Actual behavior
button does not exist, tried a myriad of tools, to no avail.
Steps to reproduce the behavior
Interview someone who is not an English native speaker. Let them tell you their experience.

Suggestion for beta URL for testing this:
https://twitter.com/home?lang=en
https://beta.twitter.com/home?lang=en

I have asked the question here now:
https://twitterdevfeedback.uservoice.com/forums/921790-twitter-developer-labs/suggestions/39046141-multilingual-accounts-language-chooser-only-engl


Fix Formatting and Test Bugs

Feature or improvement description

This PR silences the pandas warning when running in a way that maintains floris-caused warnings, and fixes the couple of bugs in the testing suite. Specifically, the test classes have been renamed to not violate the pytest naming convention with a a leading Test, and the tests/profiling.py and examples/example_input.json have been brought fully up to spec with the current state of the code base. Ironically, this had nothing to do with attrs at the end of the day!
Related issue, if one exists

Closes #14
Impacted areas of the software

tests/
examples/

Additional supporting information

The method to silence the pandas warning regarding the usage of np.bool was silenced in the same manner that I've implemented in OpenOA and validated to ensure we still keep our own errors/out of date code warnings.
Test results, if applicable

Tests all pass, just with the few divide by zero warnings that have always been there.

@RHammond2 what does this line in pytest.ini do:
python_files = tests/*.py


Count total number of classes of dex file

Hello, is there any way to count total of classes on dex file,
its on dalvik.system.DexFile package, but must load inside android, if possible to count it outside of android itself

i met this problem too.Have you solved it yet?