Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test failures with Octave 10 #1321

Open
mmuetzel opened this issue Feb 12, 2025 · 2 comments
Open

Test failures with Octave 10 #1321

mmuetzel opened this issue Feb 12, 2025 · 2 comments
Assignees
Milestone

Comments

@mmuetzel
Copy link
Member

The CI is up and running again after the merge of the default branch to the stable branch in preparation of Octave 10.

With that, I see the following failing tests for the symbolic package:
https://github.com/gnu-octave/octave-buildbot/actions/runs/13273893349/job/37059415356#step:14:15753

  Failure Summary:
  
    ..gw64\share\octave\packages\symbolic-3.2.1\@double\bernoulli.m  pass   15/16  
                                                  (expected failure) XFAIL   1
    ..w64\share\octave\packages\symbolic-3.2.1\@double\chebyshevT.m  pass   10/11  
                                                  (expected failure) XFAIL   1
    ..w64\share\octave\packages\symbolic-3.2.1\@double\chebyshevU.m  pass   10/11  
                                                  (expected failure) XFAIL   1
    ..mingw64\share\octave\packages\symbolic-3.2.1\@double\cosint.m  pass   15/16  
                                                  (expected failure) XFAIL   1
    ..\mingw64\share\octave\packages\symbolic-3.2.1\@double\dilog.m  pass    4/5   
                                                  (expected failure) XFAIL   1
    ..\mingw64\share\octave\packages\symbolic-3.2.1\@sym\children.m  pass    9/10  
                                                  (expected failure) XFAIL   1
    ..4\mingw64\share\octave\packages\symbolic-3.2.1\@sym\coshint.m  pass    4/5   
                                                  (expected failure) XFAIL   1
    ..64\mingw64\share\octave\packages\symbolic-3.2.1\@sym\cosint.m  pass    5/6   
                                                  (expected failure) XFAIL   1
    ..ingw64\share\octave\packages\symbolic-3.2.1\@sym\ellipticPi.m  pass    7/9   
                                                  (expected failure) XFAIL   2
    ..3-w64\mingw64\share\octave\packages\symbolic-3.2.1\@sym\eye.m  pass    8/9   
                                                  (expected failure) XFAIL   1
    ..mingw64\share\octave\packages\symbolic-3.2.1\@sym\factorial.m  pass    4/5   
                                                  (expected failure) XFAIL   1
    ..4\mingw64\share\octave\packages\symbolic-3.2.1\@sym\fourier.m  pass    4/5   
                                                  (expected failure) XFAIL   1
    ..\mingw64\share\octave\packages\symbolic-3.2.1\@sym\harmonic.m  pass    5/6   
                                                  (expected failure) XFAIL   1
    ..\mingw64\share\octave\packages\symbolic-3.2.1\@sym\ifourier.m  pass    7/8   
                                                  (expected failure) XFAIL   1
    ..4\mingw64\share\octave\packages\symbolic-3.2.1\@sym\isempty.m  pass    9/10  
                                                  (expected failure) XFAIL   1
    ..\mingw64\share\octave\packages\symbolic-3.2.1\@sym\lambertw.m  pass   10/11  
                                                  (expected failure) XFAIL   1
    ..4\mingw64\share\octave\packages\symbolic-3.2.1\@sym\laplace.m  pass    8/9   
                                                  (expected failure) XFAIL   1
    ..64\mingw64\share\octave\packages\symbolic-3.2.1\@sym\logint.m  pass    4/5   
                                                  (expected failure) XFAIL   1
    ..\mingw64\share\octave\packages\symbolic-3.2.1\@sym\mldivide.m  pass    4/6   
                                                                     FAIL    2
    ..64\mingw64\share\octave\packages\symbolic-3.2.1\@sym\mpower.m  pass    8/9   
                                                  (expected failure) XFAIL   1
    ..-w64\mingw64\share\octave\packages\symbolic-3.2.1\@sym\ones.m  pass    8/9   
                                                  (expected failure) XFAIL   1
    ..mingw64\share\octave\packages\symbolic-3.2.1\@sym\potential.m  pass    5/6   
                                                  (expected failure) XFAIL   1
    ..w64\mingw64\share\octave\packages\symbolic-3.2.1\@sym\round.m  pass    6/7   
                                                  (expected failure) XFAIL   1
    ..4\mingw64\share\octave\packages\symbolic-3.2.1\@sym\sinhint.m  pass    4/5   
                                                  (expected failure) XFAIL   1
    ..64\mingw64\share\octave\packages\symbolic-3.2.1\@sym\sinint.m  pass    5/6   
                                                  (expected failure) XFAIL   1
    ..-w64\mingw64\share\octave\packages\symbolic-3.2.1\@sym\size.m  pass    4/7   
                                                  (expected failure) XFAIL   3
    ..3-w64\mingw64\share\octave\packages\symbolic-3.2.1\@sym\sym.m  pass   79/86  
                                                                     FAIL    7
    ..\mingw64\share\octave\packages\symbolic-3.2.1\@sym\toeplitz.m  pass    4/6   
                                                                     FAIL    2
    ..4\mingw64\share\octave\packages\symbolic-3.2.1\@sym\vertcat.m  pass   10/11  
                                                  (expected failure) XFAIL   1
    ..w64\mingw64\share\octave\packages\symbolic-3.2.1\@sym\zeros.m  pass    8/9   
                                                  (expected failure) XFAIL   1
    ..-02-23-w64\mingw64\share\octave\packages\symbolic-3.2.1\vpa.m  pass   31/34  
                                                                     FAIL    2
                                                  (expected failure) XFAIL   1
  
  Summary:
  
    PASS                             2431
    FAIL                               13
    XFAIL (expected failure)           31

Part of the verbose log:

  >>>>> processing D:\a\octave-buildbot\octave-buildbot\octave-2025-02-11-02-23-w64\mingw64\share\octave\packages\symbolic-3.2.1\@sym\mldivide.m
  ***** warning <vpa backslash>
   % vpa, nearly singular matrix
   A = sym([1 2; 2 4]);
   A(1,1) = vpa('1.001');
   b = sym([1; 2]);
   x = A \ b;
   y = [sym(0); vpa('0.5')];
   assert (isequal (x, y))
  !!!!! warning failed.
  Expected <vpa backslash>, but got <implicit conversion from string to real N-D array>
  
  ***** warning <vpa backslash>
   % vpa, singular rhs
   A = sym([1 2; 2 4]);
   b = [vpa('1.01'); vpa('2')];
   x = A \ b;
   assert (all(isnan(x)))
  !!!!! warning failed.
  Expected <vpa backslash>, but got <implicit conversion from string to real N-D array>
  
[...]

  >>>>> processing D:\a\octave-buildbot\octave-buildbot\octave-2025-02-11-02-23-w64\mingw64\share\octave\packages\symbolic-3.2.1\@sym\sym.m
  ***** warning <dangerous> x = sym (1/2);
  !!!!! warning failed.
  Expected <dangerous>, but got <concatenation of single and double quoted string objects creates a single quoted string object>
  
  ***** warning <dangerous> sym (1e16);
  !!!!! warning failed.
  Expected <dangerous>, but got <concatenation of single and double quoted string objects creates a single quoted string object>
  
  ***** warning <dangerous> sym (-1e16);
  !!!!! warning failed.
  Expected <dangerous>, but got <concatenation of single and double quoted string objects creates a single quoted string object>
  
  ***** warning <dangerous> sym (10.33);
  !!!!! warning failed.
  Expected <dangerous>, but got <concatenation of single and double quoted string objects creates a single quoted string object>
  
  ***** warning <dangerous> sym (-5.23);
  !!!!! warning failed.
  Expected <dangerous>, but got <concatenation of single and double quoted string objects creates a single quoted string object>
  
  ***** warning <dangerous> sym (sqrt (1.4142135623731));
  !!!!! warning failed.
  Expected <dangerous>, but got <concatenation of single and double quoted string objects creates a single quoted string object>
  
  ***** warning <dangerous> sym ([1.2 1.3]);
  !!!!! warning failed.
  Expected <dangerous>, but got <implicit conversion from string to real N-D array>
  
[...]

  >>>>> processing D:\a\octave-buildbot\octave-buildbot\octave-2025-02-11-02-23-w64\mingw64\share\octave\packages\symbolic-3.2.1\@sym\toeplitz.m
  ***** warning <diagonal conflict>
   % mismatch
   syms x
   B = toeplitz([10 x], [1 3 x]);
  !!!!! warning failed.
  Expected <diagonal conflict>, but got <implicit conversion from string to real N-D array>
  
  ***** warning <diagonal conflict>
   % scalar
   B = toeplitz(sym(2), 3);
   assert (isequal (B, sym(2)))
  !!!!! warning failed.
  Expected <diagonal conflict>, but got <implicit conversion from string to real N-D array>
  
[...]

  >>>>> processing D:\a\octave-buildbot\octave-buildbot\octave-2025-02-11-02-23-w64\mingw64\share\octave\packages\symbolic-3.2.1\vpa.m
  ***** xtest
   % non-equality of vpa that "might be" be integers: Issue #1285
   a = vpa ("123", 32);
   b = vpa ("123", 64);
   assert (~ logical (a == b))
  !!!!! known failure
  assert (!logical (a == b)) failed
  ***** warning <dangerous> vpa ('sqrt(2.0)');
  !!!!! warning failed.
  Expected <dangerous>, but got <concatenation of single and double quoted string objects creates a single quoted string object>
  
  ***** warning <dangerous>
   a = vpa('2**0.5');
   b = vpa(sqrt(sym(2)));
   assert (isequal (a, b))
  !!!!! warning failed.
  Expected <dangerous>, but got <implicit conversion from string to real N-D array>
  

It looks like different warnings (or different wording?) are triggered with Octave 10 compared to previous versions.

@mmuetzel
Copy link
Member Author

Maybe related to the changes in bug #41028.

@cbm755 cbm755 self-assigned this Feb 25, 2025
@cbm755 cbm755 added this to the 3.2.2 milestone Feb 25, 2025
@cbm755
Copy link
Collaborator

cbm755 commented Feb 25, 2025

regarding warning('on', 'all'), see also #1310, #1317.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants